Nov 08 18:22:34 user nova-compute[74820]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74820) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 18:22:34 user nova-compute[74820]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74820) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 18:22:34 user nova-compute[74820]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74820) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 18:22:34 user nova-compute[74820]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 18:22:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:22:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.023s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:22:34 user nova-compute[74820]: INFO nova.virt.driver [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 18:22:35 user nova-compute[74820]: INFO nova.compute.provider_config [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Acquiring lock "singleton_lock" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Acquired lock "singleton_lock" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Releasing lock "singleton_lock" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Full set of CONF: {{(pid=74820) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ******************************************************************************** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Configuration options gathered from: {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ================================================================================ {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] allow_resize_to_same_host      = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] arq_binding_timeout            = 300 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] backdoor_port                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] backdoor_socket                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] block_device_allocate_retries  = 300 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] block_device_allocate_retries_interval = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cert                           = self.pem {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute_monitors               = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] config_dir                     = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] config_drive_format            = iso9660 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] config_source                  = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] console_host                   = user {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] control_exchange               = nova {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cpu_allocation_ratio           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] daemon                         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] debug                          = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] default_access_ip_network_name = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] default_availability_zone      = nova {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] default_ephemeral_format       = ext4 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] default_green_pool_size        = 1000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] default_schedule_zone          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] disk_allocation_ratio          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] enable_new_services            = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] enabled_ssl_apis               = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] flat_injected                  = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] force_config_drive             = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] force_raw_images               = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] graceful_shutdown_timeout      = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] heal_instance_info_cache_interval = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] host                           = user {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_build_timeout         = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_delete_interval       = 300 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_name_template         = instance-%08x {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_usage_audit           = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_usage_audit_period    = month {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] internal_service_availability_zone = internal {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] key                            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] live_migration_retry_count     = 30 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_config_append              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_dir                        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_file                       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_options                    = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_rotate_interval            = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_rotate_interval_type       = days {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] log_rotation_type              = none {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] long_rpc_timeout               = 1800 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] max_concurrent_builds          = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] max_concurrent_live_migrations = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] max_concurrent_snapshots       = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] max_local_block_devices        = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] max_logfile_count              = 30 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] max_logfile_size_mb            = 200 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] maximum_instance_delete_attempts = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metadata_listen                = 0.0.0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metadata_listen_port           = 8775 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metadata_workers               = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] migrate_max_retries            = -1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] mkisofs_cmd                    = genisoimage {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] my_ip                          = 10.0.0.210 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] network_allocate_retries       = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] osapi_compute_listen_port      = 8774 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] osapi_compute_unique_server_name_scope =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] osapi_compute_workers          = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] password_length                = 12 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] periodic_enable                = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] periodic_fuzzy_delay           = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] pointer_model                  = ps2mouse {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] preallocate_images             = none {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] publish_errors                 = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] pybasedir                      = /opt/stack/nova {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ram_allocation_ratio           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rate_limit_burst               = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rate_limit_except_level        = CRITICAL {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rate_limit_interval            = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reboot_timeout                 = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reclaim_instance_interval      = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] record                         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reimage_timeout_per_gb         = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] report_interval                = 120 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rescue_timeout                 = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reserved_host_cpus             = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reserved_host_disk_mb          = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reserved_host_memory_mb        = 512 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] reserved_huge_pages            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] resize_confirm_window          = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] resize_fs_using_block_device   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] resume_guests_state_on_host_boot = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rpc_response_timeout           = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] run_external_periodic_tasks    = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] running_deleted_instance_action = reap {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] running_deleted_instance_timeout = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler_instance_sync_interval = 120 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_down_time              = 720 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] servicegroup_driver            = db {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] shelved_offload_time           = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] shelved_poll_interval          = 3600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] shutdown_timeout               = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] source_is_ipv6                 = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ssl_only                       = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] state_path                     = /opt/stack/data/nova {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] sync_power_state_interval      = 600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] sync_power_state_pool_size     = 1000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] syslog_log_facility            = LOG_USER {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] tempdir                        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] timeout_nbd                    = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] transport_url                  = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] update_resources_interval      = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_cow_images                 = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_eventlog                   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_journal                    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_json                       = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_rootwrap_daemon            = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_stderr                     = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] use_syslog                     = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vcpu_pin_set                   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plugging_is_fatal          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plugging_timeout           = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] virt_mkfs                      = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] volume_usage_poll_interval     = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] watch_log_file                 = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] web                            = /usr/share/spice-html5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_concurrency.disable_process_locking = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.auth_strategy              = keystone {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.compute_link_prefix        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.dhcp_domain                = novalocal {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.enable_instance_password   = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.glance_link_prefix         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.instance_list_per_project_cells = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.list_records_by_skipping_down_cells = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.local_metadata_per_cell    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.max_limit                  = 1000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.metadata_cache_expiration  = 15 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.neutron_default_tenant_id  = default {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.use_forwarded_for          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.use_neutron_default_nets   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_dynamic_targets = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_jsonfile_path   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.backend_argument         = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.config_prefix            = cache.oslo {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.dead_timeout             = 60.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.debug_cache_backend      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.enable_retry_client      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.enable_socket_keepalive  = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.enabled                  = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.expiration_time          = 600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.hashclient_retry_attempts = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_dead_retry      = 300 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_password        =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_sasl_enabled    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.memcache_username        =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.proxies                  = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.retry_attempts           = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.retry_delay              = 0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.socket_keepalive_count   = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.socket_keepalive_idle    = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.socket_keepalive_interval = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.tls_allowed_ciphers      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.tls_cafile               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.tls_certfile             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.tls_enabled              = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cache.tls_keyfile              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.auth_section            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.auth_type               = password {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.cafile                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.certfile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.collect_timing          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.cross_az_attach         = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.debug                   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.endpoint_template       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.http_retries            = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.insecure                = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.keyfile                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.os_region_name          = RegionOne {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.split_loggers           = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cinder.timeout                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.cpu_dedicated_set      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.cpu_shared_set         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.image_type_exclude_list = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.resource_provider_association_refresh = 300 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.shutdown_retry_interval = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] conductor.workers              = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] console.allowed_origins        = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] console.ssl_ciphers            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] console.ssl_minimum_version    = default {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] consoleauth.token_ttl          = 600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.cafile                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.certfile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.collect_timing          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.connect_retries         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.connect_retry_delay     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.endpoint_override       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.insecure                = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.keyfile                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.max_version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.min_version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.region_name             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.service_name            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.service_type            = accelerator {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.split_loggers           = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.status_code_retries     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.timeout                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] cyborg.version                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.backend               = sqlalchemy {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.connection            = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.connection_debug      = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.connection_parameters =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.connection_recycle_time = 3600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.connection_trace      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.db_inc_retry_interval = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.db_max_retries        = 20 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.db_max_retry_interval = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.db_retry_interval     = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.max_overflow          = 50 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.max_pool_size         = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.max_retries           = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.mysql_wsrep_sync_wait = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.pool_timeout          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.retry_interval        = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.slave_connection      = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] database.sqlite_synchronous    = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.backend           = sqlalchemy {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.connection        = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.connection_debug  = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.connection_parameters =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.connection_recycle_time = 3600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.connection_trace  = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.db_inc_retry_interval = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.db_max_retries    = 20 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.db_max_retry_interval = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.db_retry_interval = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.max_overflow      = 50 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.max_pool_size     = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.max_retries       = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.pool_timeout      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.retry_interval    = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.slave_connection  = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] api_database.sqlite_synchronous = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] devices.enabled_mdev_types     = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ephemeral_storage_encryption.enabled = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.api_servers             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.cafile                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.certfile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.collect_timing          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.connect_retries         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.connect_retry_delay     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.debug                   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.default_trusted_certificate_ids = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.enable_certificate_validation = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.enable_rbd_download     = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.endpoint_override       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.insecure                = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.keyfile                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.max_version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.min_version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.num_retries             = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.rbd_ceph_conf           =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.rbd_connect_timeout     = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.rbd_pool                =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.rbd_user                =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.region_name             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.service_name            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.service_type            = image {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.split_loggers           = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.status_code_retries     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.timeout                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.verify_glance_signatures = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] glance.version                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] guestfs.debug                  = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.config_drive_cdrom      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.config_drive_inject_password = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.enable_remotefx         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.instances_path_share    =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.limit_cpu_features      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.use_multipath_io        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.vswitch_name            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] mks.enabled                    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] image_cache.manager_interval   = 2400 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] image_cache.precache_concurrency = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] image_cache.remove_unused_base_images = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] image_cache.subdirectory_name  = _base {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.api_max_retries         = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.api_retry_interval      = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.auth_section            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.auth_type               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.cafile                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.certfile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.collect_timing          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.conductor_group         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.connect_retries         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.connect_retry_delay     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.endpoint_override       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.insecure                = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.keyfile                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.max_version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.min_version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.peer_list               = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.region_name             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.serial_console_state_timeout = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.service_name            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.service_type            = baremetal {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.split_loggers           = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.status_code_retries     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.timeout                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ironic.version                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] key_manager.fixed_key          = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.barbican_api_version  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.barbican_endpoint     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.barbican_endpoint_type = public {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.barbican_region_name  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.cafile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.certfile              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.collect_timing        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.insecure              = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.keyfile               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.number_of_retries     = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.retry_delay           = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.send_service_user_token = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.split_loggers         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.timeout               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.verify_ssl            = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican.verify_ssl_path       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.auth_section = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.auth_type = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.cafile   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.certfile = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.collect_timing = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.insecure = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.keyfile  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.split_loggers = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] barbican_service_user.timeout  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.approle_role_id          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.approle_secret_id        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.cafile                   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.certfile                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.collect_timing           = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.insecure                 = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.keyfile                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.kv_mountpoint            = secret {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.kv_path                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.kv_version               = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.namespace                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.root_token_id            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.split_loggers            = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.ssl_ca_crt_file          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.timeout                  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.use_ssl                  = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.auth_section          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.auth_type             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.cafile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.certfile              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.collect_timing        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.connect_retries       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.connect_retry_delay   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.endpoint_override     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.insecure              = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.keyfile               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.max_version           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.min_version           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.region_name           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.service_name          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.service_type          = identity {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.split_loggers         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.status_code_retries   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.timeout               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] keystone.version               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.connection_uri         =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_mode               = custom {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: WARNING oslo_config.cfg [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_power_governor_high = performance {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_power_management   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.device_detach_attempts = 8 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.device_detach_timeout  = 20 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.disk_cachemodes        = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.disk_prefix            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.enabled_perf_events    = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.file_backed_memory     = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.gid_maps               = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.hw_disk_discard        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.hw_machine_type        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_rbd_pool        = rbd {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_type            = default {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.images_volume_group    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.inject_key             = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.inject_partition       = -2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.inject_password        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.iscsi_iface            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.iser_use_multipath     = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_downtime = 500 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_inbound_addr = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_scheme  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_timeout_action = abort {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_tunnelled = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: WARNING oslo_config.cfg [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 18:22:35 user nova-compute[74820]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 18:22:35 user nova-compute[74820]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 18:22:35 user nova-compute[74820]: and ``live_migration_inbound_addr`` respectively.
Nov 08 18:22:35 user nova-compute[74820]: ).  Its value may be silently ignored in the future.
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.live_migration_with_native_tls = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.max_queues             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.nfs_mount_options      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.num_pcie_ports         = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.pmem_namespaces        = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.quobyte_client_cfg     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rbd_secret_uuid        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rbd_user               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rescue_image_id        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rescue_kernel_id       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.rx_queue_size          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.smbfs_mount_options    =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.snapshot_compression   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.snapshot_image_format  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.sparse_logical_volumes = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.swtpm_enabled          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.swtpm_group            = tss {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.swtpm_user             = tss {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.sysinfo_serial         = unique {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.tb_cache_size          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.tx_queue_size          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.uid_maps               = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.use_virtio_for_bridges = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.virt_type              = kvm {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.volume_clear           = zero {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.volume_clear_size      = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.volume_use_multipath   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_cache_path   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.auth_section           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.auth_type              = password {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.cafile                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.certfile               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.collect_timing         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.connect_retries        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.connect_retry_delay    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.default_floating_pool  = public {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.endpoint_override      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.extension_sync_interval = 600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.http_retries           = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.insecure               = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.keyfile                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.max_version            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.min_version            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.ovs_bridge             = br-int {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.physnets               = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.region_name            = RegionOne {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.service_metadata_proxy = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.service_name           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.service_type           = network {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.split_loggers          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.status_code_retries    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.timeout                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] neutron.version                = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] notifications.bdms_in_notifications = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] notifications.default_level    = INFO {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] notifications.notification_format = unversioned {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] notifications.notify_on_state_change = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] pci.alias                      = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] pci.device_spec                = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] pci.report_in_placement        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.auth_section         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.auth_type            = password {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.cafile               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.certfile             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.collect_timing       = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.connect_retries      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.connect_retry_delay  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.default_domain_id    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.default_domain_name  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.domain_id            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.domain_name          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.endpoint_override    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.insecure             = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.keyfile              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.max_version          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.min_version          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.password             = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.project_domain_id    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.project_domain_name  = Default {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.project_id           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.project_name         = service {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.region_name          = RegionOne {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.service_name         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.service_type         = placement {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.split_loggers        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.status_code_retries  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.system_scope         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.timeout              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.trust_id             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.user_domain_id       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.user_domain_name     = Default {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.user_id              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.username             = placement {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] placement.version              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.cores                    = 20 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.count_usage_from_placement = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.injected_file_content_bytes = 10240 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.injected_file_path_length = 255 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.injected_files           = 5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.instances                = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.key_pairs                = 100 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.metadata_items           = 128 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.ram                      = 51200 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.recheck_quota            = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.server_group_members     = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] quota.server_groups            = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rdp.enabled                    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.image_metadata_prefilter = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.max_attempts         = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.max_placement_results = 1000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] scheduler.workers              = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.host_subset_size = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.isolated_hosts = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.isolated_images = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.pci_in_placement = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.track_instance_changes = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metrics.required               = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metrics.weight_multiplier      = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] metrics.weight_setting         = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] serial_console.enabled         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] serial_console.port_range      = 10000:20000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] serial_console.serialproxy_port = 6083 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.auth_section      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.auth_type         = password {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.cafile            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.certfile          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.collect_timing    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.insecure          = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.keyfile           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.send_service_user_token = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.split_loggers     = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] service_user.timeout           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.agent_enabled            = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.enabled                  = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.html5proxy_port          = 6082 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.image_compression        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.jpeg_compression         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.playback_compression     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.server_listen            = 127.0.0.1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.streaming_mode           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] spice.zlib_compression         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] upgrade_levels.baseapi         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] upgrade_levels.cert            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] upgrade_levels.compute         = auto {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] upgrade_levels.conductor       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] upgrade_levels.scheduler       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.cafile = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.certfile = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.insecure = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vendordata_dynamic_auth.timeout = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.api_retry_count         = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.ca_file                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.cache_prefix            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.cluster_name            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.connection_pool_size    = 10 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.console_delay_seconds   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.datastore_regex         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.host_ip                 = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.host_password           = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.host_port               = 443 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.host_username           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.insecure                = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.integration_bridge      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.maximum_objects         = 100 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.pbm_default_policy      = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.pbm_enabled             = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.pbm_wsdl_location       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.serial_port_proxy_uri   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.serial_port_service_uri = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.task_poll_interval      = 0.5 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.use_linked_clone        = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.vnc_keymap              = en-us {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.vnc_port                = 5900 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vmware.vnc_port_total          = 10000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.auth_schemes               = ['none'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.enabled                    = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.novncproxy_port            = 6080 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.vencrypt_ca_certs          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.vencrypt_client_cert       = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vnc.vencrypt_client_key        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.disable_rootwrap   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.enable_numa_live_migration = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.libvirt_disable_apic = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.client_socket_timeout     = 900 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.default_pool_size         = 1000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.keep_alive                = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.max_header_line           = 16384 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.ssl_ca_file               = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.ssl_cert_file             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.ssl_key_file              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.tcp_keepidle              = 600 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] zvm.ca_file                    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] zvm.cloud_connector_url        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] zvm.reachable_timeout          = 300 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.enforce_new_defaults = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.enforce_scope      = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.policy_default_rule = default {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.connection_string     = messaging:// {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.enabled               = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.es_doc_type           = notification {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.es_scroll_size        = 10000 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.es_scroll_time        = 2m {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.filter_error_trace    = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.hmac_keys             = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.sentinel_service_name = mymaster {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.socket_timeout        = 0.1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.trace_requests        = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler.trace_sqlalchemy      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler_jaeger.process_tags   = {} {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler_jaeger.service_name_prefix = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] profiler_otlp.service_name_prefix = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] remote_debug.host              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] remote_debug.port              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_notifications.retry = -1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.auth_section        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.auth_type           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.cafile              = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.certfile            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.collect_timing      = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.connect_retries     = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.connect_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.endpoint_id         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.endpoint_override   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.insecure            = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.keyfile             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.max_version         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.min_version         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.region_name         = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.service_name        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.service_type        = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.split_loggers       = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.status_code_retries = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.status_code_retry_delay = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.timeout             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.valid_interfaces    = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_limit.version             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_reports.file_event_handler = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] oslo_reports.log_dir           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_ovs_privileged.group  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] vif_plug_ovs_privileged.user   = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.isolate_vif         = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] os_brick.lock_path             = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] privsep_osbrick.capabilities   = [21] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] privsep_osbrick.group          = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] privsep_osbrick.helper_command = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] privsep_osbrick.user           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] nova_sys_admin.group           = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] nova_sys_admin.helper_command  = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] nova_sys_admin.user            = None {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG oslo_service.service [None req-a733dee5-680e-4616-8dfe-0bc4853f2715 None None] ******************************************************************************** {{(pid=74820) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 18:22:35 user nova-compute[74820]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Connecting to libvirt: qemu:///system {{(pid=74820) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3e494aefb0> {{(pid=74820) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 18:22:35 user nova-compute[74820]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 18:22:35 user nova-compute[74820]: WARNING nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3e494aefb0> {{(pid=74820) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Starting native event thread {{(pid=74820) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Starting green dispatch thread {{(pid=74820) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Starting connection event dispatch thread {{(pid=74820) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 18:22:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Connection event '1' reason 'None'
Nov 08 18:22:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 18:22:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.mount [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Initialising _HostMountState generation 0 {{(pid=74820) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 18:22:42 user nova-compute[74820]: INFO nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host capabilities <capabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <host>
Nov 08 18:22:42 user nova-compute[74820]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 18:22:42 user nova-compute[74820]:     <cpu>
Nov 08 18:22:42 user nova-compute[74820]:       <arch>x86_64</arch>
Nov 08 18:22:42 user nova-compute[74820]:       <model>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <microcode version='1070'/>
Nov 08 18:22:42 user nova-compute[74820]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 18:22:42 user nova-compute[74820]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='osxsave'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='invtsc'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='rsba'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 18:22:42 user nova-compute[74820]:       <pages unit='KiB' size='4'/>
Nov 08 18:22:42 user nova-compute[74820]:       <pages unit='KiB' size='2048'/>
Nov 08 18:22:42 user nova-compute[74820]:     </cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <power_management>
Nov 08 18:22:42 user nova-compute[74820]:       <suspend_mem/>
Nov 08 18:22:42 user nova-compute[74820]:       <suspend_disk/>
Nov 08 18:22:42 user nova-compute[74820]:       <suspend_hybrid/>
Nov 08 18:22:42 user nova-compute[74820]:     </power_management>
Nov 08 18:22:42 user nova-compute[74820]:     <iommu support='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <migration_features>
Nov 08 18:22:42 user nova-compute[74820]:       <live/>
Nov 08 18:22:42 user nova-compute[74820]:       <uri_transports>
Nov 08 18:22:42 user nova-compute[74820]:         <uri_transport>tcp</uri_transport>
Nov 08 18:22:42 user nova-compute[74820]:         <uri_transport>rdma</uri_transport>
Nov 08 18:22:42 user nova-compute[74820]:       </uri_transports>
Nov 08 18:22:42 user nova-compute[74820]:     </migration_features>
Nov 08 18:22:42 user nova-compute[74820]:     <topology>
Nov 08 18:22:42 user nova-compute[74820]:       <cells num='2'>
Nov 08 18:22:42 user nova-compute[74820]:         <cell id='0'>
Nov 08 18:22:42 user nova-compute[74820]:           <memory unit='KiB'>8189224</memory>
Nov 08 18:22:42 user nova-compute[74820]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 08 18:22:42 user nova-compute[74820]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 18:22:42 user nova-compute[74820]:           <distances>
Nov 08 18:22:42 user nova-compute[74820]:             <sibling id='0' value='10'/>
Nov 08 18:22:42 user nova-compute[74820]:             <sibling id='1' value='20'/>
Nov 08 18:22:42 user nova-compute[74820]:           </distances>
Nov 08 18:22:42 user nova-compute[74820]:           <cpus num='6'>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 18:22:42 user nova-compute[74820]:           </cpus>
Nov 08 18:22:42 user nova-compute[74820]:         </cell>
Nov 08 18:22:42 user nova-compute[74820]:         <cell id='1'>
Nov 08 18:22:42 user nova-compute[74820]:           <memory unit='KiB'>8206460</memory>
Nov 08 18:22:42 user nova-compute[74820]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 08 18:22:42 user nova-compute[74820]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 18:22:42 user nova-compute[74820]:           <distances>
Nov 08 18:22:42 user nova-compute[74820]:             <sibling id='0' value='20'/>
Nov 08 18:22:42 user nova-compute[74820]:             <sibling id='1' value='10'/>
Nov 08 18:22:42 user nova-compute[74820]:           </distances>
Nov 08 18:22:42 user nova-compute[74820]:           <cpus num='6'>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 18:22:42 user nova-compute[74820]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 18:22:42 user nova-compute[74820]:           </cpus>
Nov 08 18:22:42 user nova-compute[74820]:         </cell>
Nov 08 18:22:42 user nova-compute[74820]:       </cells>
Nov 08 18:22:42 user nova-compute[74820]:     </topology>
Nov 08 18:22:42 user nova-compute[74820]:     <cache>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 18:22:42 user nova-compute[74820]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 18:22:42 user nova-compute[74820]:     </cache>
Nov 08 18:22:42 user nova-compute[74820]:     <secmodel>
Nov 08 18:22:42 user nova-compute[74820]:       <model>apparmor</model>
Nov 08 18:22:42 user nova-compute[74820]:       <doi>0</doi>
Nov 08 18:22:42 user nova-compute[74820]:     </secmodel>
Nov 08 18:22:42 user nova-compute[74820]:     <secmodel>
Nov 08 18:22:42 user nova-compute[74820]:       <model>dac</model>
Nov 08 18:22:42 user nova-compute[74820]:       <doi>0</doi>
Nov 08 18:22:42 user nova-compute[74820]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 18:22:42 user nova-compute[74820]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 18:22:42 user nova-compute[74820]:     </secmodel>
Nov 08 18:22:42 user nova-compute[74820]:   </host>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='alpha'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>clipper</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='armv6l'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>spitz</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>nuri</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>kzm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sx1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>z2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>tosa</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>n810</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>n800</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>terrier</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>midway</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>microbit</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>verdex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>highbank</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>akita</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>connex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>collie</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='armv7l'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>spitz</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>nuri</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>kzm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sx1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>z2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>tosa</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>n810</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>n800</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>terrier</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>midway</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>microbit</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>verdex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>highbank</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>akita</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>connex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>collie</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='aarch64'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>spitz</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>nuri</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>kzm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sx1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>z2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>tosa</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>n810</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>n800</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>terrier</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>midway</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>microbit</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>verdex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>highbank</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>akita</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>connex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>collie</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <acpi default='on' toggle='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='cris'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='i686'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>isapc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>microvm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='kvm'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <pae/>
Nov 08 18:22:42 user nova-compute[74820]:       <nonpae/>
Nov 08 18:22:42 user nova-compute[74820]:       <acpi default='on' toggle='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:       <apic default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='m68k'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>an5206</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>q800</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='microblaze'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='microblazeel'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='mips'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='16'>malta</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='mipsel'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='16'>malta</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='mips64'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='16'>malta</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>pica61</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>magnum</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='mips64el'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='16'>malta</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>pica61</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>magnum</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='16'>boston</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='ppc'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mac99</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>40p</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>taihu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='ppc64'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>taihu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>40p</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mac99</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='ppc64le'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>taihu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>40p</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>mac99</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='riscv32'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='8'>spike</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='8'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='riscv64'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='8'>spike</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='8'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='s390x'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='sh4'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>shix</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>r2d</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='sh4eb'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>shix</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>r2d</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='sparc'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>LX</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='sparc64'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>niagara</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='x86_64'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>64</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='1'>isapc</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>microvm</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='kvm'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <acpi default='on' toggle='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:       <apic default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='xtensa'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>sim</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>kc705</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ml605</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx200</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx60</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]:   <guest>
Nov 08 18:22:42 user nova-compute[74820]:     <os_type>hvm</os_type>
Nov 08 18:22:42 user nova-compute[74820]:     <arch name='xtensaeb'>
Nov 08 18:22:42 user nova-compute[74820]:       <wordsize>32</wordsize>
Nov 08 18:22:42 user nova-compute[74820]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='4'>sim</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>kc705</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ml605</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>virt</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx200</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>lx60</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 18:22:42 user nova-compute[74820]:       <domain type='qemu'/>
Nov 08 18:22:42 user nova-compute[74820]:     </arch>
Nov 08 18:22:42 user nova-compute[74820]:     <features>
Nov 08 18:22:42 user nova-compute[74820]:       <cpuselection/>
Nov 08 18:22:42 user nova-compute[74820]:       <deviceboot/>
Nov 08 18:22:42 user nova-compute[74820]:       <disksnapshot default='on' toggle='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     </features>
Nov 08 18:22:42 user nova-compute[74820]:   </guest>
Nov 08 18:22:42 user nova-compute[74820]: </capabilities>
Nov 08 18:22:42 user nova-compute[74820]: 
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-q35-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>i686</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='288'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'/>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='lm'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </disk>
Nov 08 18:22:42 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </graphics>
Nov 08 18:22:42 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </video>
Nov 08 18:22:42 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:42 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:42 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </rng>
Nov 08 18:22:42 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:42 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </tpm>
Nov 08 18:22:42 user nova-compute[74820]:   </devices>
Nov 08 18:22:42 user nova-compute[74820]:   <features>
Nov 08 18:22:42 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:   </features>
Nov 08 18:22:42 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-i440fx-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>i686</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='255'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'/>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='lm'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ide</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </disk>
Nov 08 18:22:42 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </graphics>
Nov 08 18:22:42 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </video>
Nov 08 18:22:42 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:42 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:42 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </rng>
Nov 08 18:22:42 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:42 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </tpm>
Nov 08 18:22:42 user nova-compute[74820]:   </devices>
Nov 08 18:22:42 user nova-compute[74820]:   <features>
Nov 08 18:22:42 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:   </features>
Nov 08 18:22:42 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-q35-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>i686</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='288'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'/>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='lm'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </disk>
Nov 08 18:22:42 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </graphics>
Nov 08 18:22:42 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </video>
Nov 08 18:22:42 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:42 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:42 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </rng>
Nov 08 18:22:42 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:42 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </tpm>
Nov 08 18:22:42 user nova-compute[74820]:   </devices>
Nov 08 18:22:42 user nova-compute[74820]:   <features>
Nov 08 18:22:42 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:   </features>
Nov 08 18:22:42 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-i440fx-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>i686</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='255'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'/>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='lm'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ide</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </disk>
Nov 08 18:22:42 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </graphics>
Nov 08 18:22:42 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </video>
Nov 08 18:22:42 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:42 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:42 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </rng>
Nov 08 18:22:42 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:42 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </tpm>
Nov 08 18:22:42 user nova-compute[74820]:   </devices>
Nov 08 18:22:42 user nova-compute[74820]:   <features>
Nov 08 18:22:42 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:   </features>
Nov 08 18:22:42 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-q35-jammy</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>x86_64</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='288'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>efi</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='invtsc'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='rsba'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </disk>
Nov 08 18:22:42 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </graphics>
Nov 08 18:22:42 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </video>
Nov 08 18:22:42 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:42 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:42 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </rng>
Nov 08 18:22:42 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:42 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </tpm>
Nov 08 18:22:42 user nova-compute[74820]:   </devices>
Nov 08 18:22:42 user nova-compute[74820]:   <features>
Nov 08 18:22:42 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:   </features>
Nov 08 18:22:42 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-i440fx-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>x86_64</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='255'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>efi</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='invtsc'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='rsba'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ide</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </disk>
Nov 08 18:22:42 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </graphics>
Nov 08 18:22:42 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </video>
Nov 08 18:22:42 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:42 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:42 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </rng>
Nov 08 18:22:42 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:42 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </tpm>
Nov 08 18:22:42 user nova-compute[74820]:   </devices>
Nov 08 18:22:42 user nova-compute[74820]:   <features>
Nov 08 18:22:42 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:42 user nova-compute[74820]:   </features>
Nov 08 18:22:42 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 18:22:42 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:42 user nova-compute[74820]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 18:22:42 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:42 user nova-compute[74820]:   <machine>pc-q35-6.2</machine>
Nov 08 18:22:42 user nova-compute[74820]:   <arch>x86_64</arch>
Nov 08 18:22:42 user nova-compute[74820]:   <vcpu max='288'/>
Nov 08 18:22:42 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:42 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='firmware'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>efi</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </loader>
Nov 08 18:22:42 user nova-compute[74820]:   </os>
Nov 08 18:22:42 user nova-compute[74820]:   <cpu>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='invtsc'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='rsba'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:42 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm64</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>core2duo</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Westmere</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Penryn</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Opteron_G1</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Nehalem</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>Conroe</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:42 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:42 user nova-compute[74820]:     </mode>
Nov 08 18:22:42 user nova-compute[74820]:   </cpu>
Nov 08 18:22:42 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:42 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:42 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:42 user nova-compute[74820]:     </enum>
Nov 08 18:22:42 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:42 user nova-compute[74820]:   <devices>
Nov 08 18:22:42 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:42 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:42 user nova-compute[74820]:       </enum>
Nov 08 18:22:42 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:42 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </disk>
Nov 08 18:22:43 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </graphics>
Nov 08 18:22:43 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </video>
Nov 08 18:22:43 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:43 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:43 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </rng>
Nov 08 18:22:43 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:43 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </tpm>
Nov 08 18:22:43 user nova-compute[74820]:   </devices>
Nov 08 18:22:43 user nova-compute[74820]:   <features>
Nov 08 18:22:43 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:43 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:43 user nova-compute[74820]:   </features>
Nov 08 18:22:43 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:43 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 18:22:43 user nova-compute[74820]: <domainCapabilities>
Nov 08 18:22:43 user nova-compute[74820]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 18:22:43 user nova-compute[74820]:   <domain>kvm</domain>
Nov 08 18:22:43 user nova-compute[74820]:   <machine>pc-i440fx-jammy</machine>
Nov 08 18:22:43 user nova-compute[74820]:   <arch>x86_64</arch>
Nov 08 18:22:43 user nova-compute[74820]:   <vcpu max='255'/>
Nov 08 18:22:43 user nova-compute[74820]:   <iothreads supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:   <os supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:     <enum name='firmware'>
Nov 08 18:22:43 user nova-compute[74820]:       <value>efi</value>
Nov 08 18:22:43 user nova-compute[74820]:     </enum>
Nov 08 18:22:43 user nova-compute[74820]:     <loader supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>rom</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>pflash</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='readonly'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>yes</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='secure'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>no</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </loader>
Nov 08 18:22:43 user nova-compute[74820]:   </os>
Nov 08 18:22:43 user nova-compute[74820]:   <cpu>
Nov 08 18:22:43 user nova-compute[74820]:     <mode name='host-passthrough' supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='hostPassthroughMigratable'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </mode>
Nov 08 18:22:43 user nova-compute[74820]:     <mode name='maximum' supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='maximumMigratable'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>on</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>off</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </mode>
Nov 08 18:22:43 user nova-compute[74820]:     <mode name='host-model' supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <vendor>Intel</vendor>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='ss'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='vmx'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='pcid'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='hypervisor'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='arat'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='umip'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='md-clear'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='stibp'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='ssbd'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='invtsc'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='ibpb'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='ibrs'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='amd-stibp'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='rsba'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='disable' name='erms'/>
Nov 08 18:22:43 user nova-compute[74820]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 18:22:43 user nova-compute[74820]:     </mode>
Nov 08 18:22:43 user nova-compute[74820]:     <mode name='custom' supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>qemu64</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>qemu32</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>phenom</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>pentium3</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>pentium2</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>pentium</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>n270</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>kvm64</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>kvm32</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>coreduo</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>core2duo</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>athlon</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Westmere</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Snowridge</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Skylake-Server</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Skylake-Client</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>SandyBridge</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Penryn</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Opteron_G5</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Opteron_G4</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Opteron_G3</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Opteron_G2</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Opteron_G1</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Nehalem</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>IvyBridge</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Icelake-Server</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Haswell</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>EPYC-Rome</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>EPYC-Milan</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>EPYC</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Dhyana</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Cooperlake</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>Conroe</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='no'>Broadwell</model>
Nov 08 18:22:43 user nova-compute[74820]:       <model usable='yes'>486</model>
Nov 08 18:22:43 user nova-compute[74820]:     </mode>
Nov 08 18:22:43 user nova-compute[74820]:   </cpu>
Nov 08 18:22:43 user nova-compute[74820]:   <memoryBacking supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:     <enum name='sourceType'>
Nov 08 18:22:43 user nova-compute[74820]:       <value>file</value>
Nov 08 18:22:43 user nova-compute[74820]:       <value>anonymous</value>
Nov 08 18:22:43 user nova-compute[74820]:       <value>memfd</value>
Nov 08 18:22:43 user nova-compute[74820]:     </enum>
Nov 08 18:22:43 user nova-compute[74820]:   </memoryBacking>
Nov 08 18:22:43 user nova-compute[74820]:   <devices>
Nov 08 18:22:43 user nova-compute[74820]:     <disk supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='diskDevice'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>disk</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>cdrom</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>floppy</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>lun</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='bus'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>ide</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>fdc</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>sata</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </disk>
Nov 08 18:22:43 user nova-compute[74820]:     <graphics supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='type'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>sdl</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>vnc</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>spice</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>egl-headless</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </graphics>
Nov 08 18:22:43 user nova-compute[74820]:     <video supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='modelType'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>vga</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>cirrus</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>vmvga</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>qxl</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>none</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>bochs</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>ramfb</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </video>
Nov 08 18:22:43 user nova-compute[74820]:     <hostdev supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='mode'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>subsystem</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='startupPolicy'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>default</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>mandatory</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>requisite</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>optional</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='subsysType'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>usb</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>pci</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>scsi</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='capsType'/>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='pciBackend'/>
Nov 08 18:22:43 user nova-compute[74820]:     </hostdev>
Nov 08 18:22:43 user nova-compute[74820]:     <rng supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtio-non-transitional</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>random</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>egd</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>builtin</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </rng>
Nov 08 18:22:43 user nova-compute[74820]:     <filesystem supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='driverType'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>path</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>handle</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>virtiofs</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </filesystem>
Nov 08 18:22:43 user nova-compute[74820]:     <tpm supported='yes'>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='model'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>tpm-tis</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>tpm-crb</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:       <enum name='backendModel'>
Nov 08 18:22:43 user nova-compute[74820]:         <value>passthrough</value>
Nov 08 18:22:43 user nova-compute[74820]:         <value>emulator</value>
Nov 08 18:22:43 user nova-compute[74820]:       </enum>
Nov 08 18:22:43 user nova-compute[74820]:     </tpm>
Nov 08 18:22:43 user nova-compute[74820]:   </devices>
Nov 08 18:22:43 user nova-compute[74820]:   <features>
Nov 08 18:22:43 user nova-compute[74820]:     <gic supported='no'/>
Nov 08 18:22:43 user nova-compute[74820]:     <vmcoreinfo supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <genid supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <backingStoreInput supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <backup supported='yes'/>
Nov 08 18:22:43 user nova-compute[74820]:     <sev supported='no'/>
Nov 08 18:22:43 user nova-compute[74820]:   </features>
Nov 08 18:22:43 user nova-compute[74820]: </domainCapabilities>
Nov 08 18:22:43 user nova-compute[74820]:  {{(pid=74820) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74820) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74820) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Checking secure boot support for host arch (x86_64) {{(pid=74820) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Secure Boot support detected
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] cpu compare xml: <cpu match="exact">
Nov 08 18:22:43 user nova-compute[74820]:   <model>Nehalem</model>
Nov 08 18:22:43 user nova-compute[74820]: </cpu>
Nov 08 18:22:43 user nova-compute[74820]:  {{(pid=74820) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.virt.node [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Generated node identity b6dd5339-b9ae-45ca-86de-93315b7f0863
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.virt.node [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Wrote node identity b6dd5339-b9ae-45ca-86de-93315b7f0863 to /opt/stack/data/nova/compute_id
Nov 08 18:22:43 user nova-compute[74820]: WARNING nova.compute.manager [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Compute nodes ['b6dd5339-b9ae-45ca-86de-93315b7f0863'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.compute.manager [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 18:22:43 user nova-compute[74820]: WARNING nova.compute.manager [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 18:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:22:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:22:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Hypervisor/Node resource view: name=user free_ram=11014MB free_disk=26.18010711669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:22:43 user nova-compute[74820]: WARNING nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] No compute node record for user:b6dd5339-b9ae-45ca-86de-93315b7f0863: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b6dd5339-b9ae-45ca-86de-93315b7f0863 could not be found.
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Compute node record created for user:user with uuid: b6dd5339-b9ae-45ca-86de-93315b7f0863
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] [req-6565a0b5-a4fe-4626-81fc-e6454b275c36] Created resource provider record via placement API for resource provider with UUID b6dd5339-b9ae-45ca-86de-93315b7f0863 and name user.
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74820) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 18:22:43 user nova-compute[74820]: INFO nova.virt.libvirt.host [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] kernel doesn't support AMD SEV
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Libvirt baseline CPU <cpu>
Nov 08 18:22:43 user nova-compute[74820]:   <arch>x86_64</arch>
Nov 08 18:22:43 user nova-compute[74820]:   <model>Nehalem</model>
Nov 08 18:22:43 user nova-compute[74820]:   <vendor>Intel</vendor>
Nov 08 18:22:43 user nova-compute[74820]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 18:22:43 user nova-compute[74820]: </cpu>
Nov 08 18:22:43 user nova-compute[74820]:  {{(pid=74820) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Updated inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Updating resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 generation from 0 to 1 during operation: update_inventory {{(pid=74820) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 18:22:43 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Updating resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 generation from 1 to 2 during operation: update_traits {{(pid=74820) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG nova.service [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Creating RPC server for service compute {{(pid=74820) start /opt/stack/nova/nova/service.py:182}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG nova.service [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] Join ServiceGroup membership for this service compute {{(pid=74820) start /opt/stack/nova/nova/service.py:199}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG nova.servicegroup.drivers.db [None req-7c64fdb0-6760-4f9d-a6c8-de5050892048 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74820) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:22:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:23:34 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:23:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:23:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:23:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=10468MB free_disk=26.084003448486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:23:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:24:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:24:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:24:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:24:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=10397MB free_disk=26.148799896240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:24:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:24:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:24:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:24:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:24:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:24:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:25:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:25:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:25:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:25:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=10348MB free_disk=25.903152465820312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:25:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:26:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:26:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:26:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9665MB free_disk=25.929378509521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:26:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:26:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:26:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:26:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:26:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:26:46 user nova-compute[74820]: INFO nova.compute.claims [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Claim successful on node user
Nov 08 18:26:46 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:26:47 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:26:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:26:47 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Creating image(s)
Nov 08 18:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG nova.policy [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5790613f8a24f52897aedd0634f7f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77a76c049904c6abe35b10929563c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG nova.virt.images [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] 71d031e1-e4c3-46c0-bfb5-c8044e0fbc93 was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.part /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.part /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.converted" returned: 0 in 0.137s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.332s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:48 user nova-compute[74820]: INFO oslo.privsep.daemon [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpeekbn8l_/privsep.sock']
Nov 08 18:26:48 user sudo[84290]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpeekbn8l_/privsep.sock
Nov 08 18:26:48 user sudo[84290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 18:26:50 user sudo[84290]: pam_unix(sudo:session): session closed for user root
Nov 08 18:26:50 user nova-compute[74820]: INFO oslo.privsep.daemon [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Spawned new privsep daemon via rootwrap
Nov 08 18:26:50 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Successfully created port: 6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:26:50 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 18:26:50 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 18:26:50 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 18:26:50 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84293
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.164s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk 1073741824" returned: 0 in 0.040s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:26:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Cannot resize image /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Ensure instance console log exists: /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:52 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Successfully updated port: 6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:26:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:26:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:26:52 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:26:52 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Instance network_info: |[{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Start _get_guest_xml network_info=[{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:26:53 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:26:53 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1644669325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1644669325',id=1,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-uwqjhdqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:47Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=3cbcbe67-7c9c-46a8-8617-85921d7fb83f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-changed-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Refreshing instance network info cache due to event network-changed-6d64d0e5-098d-417c-873e-d2dcc1f57287. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] Acquiring lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] Acquired lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.network.neutron [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Refreshing network info cache for port 6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:26:53 user nova-compute[74820]:   <uuid>3cbcbe67-7c9c-46a8-8617-85921d7fb83f</uuid>
Nov 08 18:26:53 user nova-compute[74820]:   <name>instance-00000001</name>
Nov 08 18:26:53 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:26:53 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:26:53 user nova-compute[74820]:   <metadata>
Nov 08 18:26:53 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:26:53 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:26:53 user nova-compute[74820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1644669325</nova:name>
Nov 08 18:26:53 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:26:53</nova:creationTime>
Nov 08 18:26:53 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:26:53 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:26:53 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:26:53 user nova-compute[74820]:       <nova:owner>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:user uuid="c5790613f8a24f52897aedd0634f7f7f">tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member</nova:user>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:project uuid="e77a76c049904c6abe35b10929563c00">tempest-ServerBootFromVolumeStableRescueTest-516881030</nova:project>
Nov 08 18:26:53 user nova-compute[74820]:       </nova:owner>
Nov 08 18:26:53 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:26:53 user nova-compute[74820]:       <nova:ports>
Nov 08 18:26:53 user nova-compute[74820]:         <nova:port uuid="6d64d0e5-098d-417c-873e-d2dcc1f57287">
Nov 08 18:26:53 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:26:53 user nova-compute[74820]:         </nova:port>
Nov 08 18:26:53 user nova-compute[74820]:       </nova:ports>
Nov 08 18:26:53 user nova-compute[74820]:     </nova:instance>
Nov 08 18:26:53 user nova-compute[74820]:   </metadata>
Nov 08 18:26:53 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:26:53 user nova-compute[74820]:     <system>
Nov 08 18:26:53 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:26:53 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:26:53 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:26:53 user nova-compute[74820]:       <entry name="serial">3cbcbe67-7c9c-46a8-8617-85921d7fb83f</entry>
Nov 08 18:26:53 user nova-compute[74820]:       <entry name="uuid">3cbcbe67-7c9c-46a8-8617-85921d7fb83f</entry>
Nov 08 18:26:53 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:26:53 user nova-compute[74820]:     </system>
Nov 08 18:26:53 user nova-compute[74820]:   </sysinfo>
Nov 08 18:26:53 user nova-compute[74820]:   <os>
Nov 08 18:26:53 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:26:53 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:26:53 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:26:53 user nova-compute[74820]:   </os>
Nov 08 18:26:53 user nova-compute[74820]:   <features>
Nov 08 18:26:53 user nova-compute[74820]:     <acpi/>
Nov 08 18:26:53 user nova-compute[74820]:     <apic/>
Nov 08 18:26:53 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:26:53 user nova-compute[74820]:   </features>
Nov 08 18:26:53 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:26:53 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:26:53 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:26:53 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:26:53 user nova-compute[74820]:   </clock>
Nov 08 18:26:53 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:26:53 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:26:53 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:26:53 user nova-compute[74820]:   </cpu>
Nov 08 18:26:53 user nova-compute[74820]:   <devices>
Nov 08 18:26:53 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:26:53 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:26:53 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk"/>
Nov 08 18:26:53 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:26:53 user nova-compute[74820]:     </disk>
Nov 08 18:26:53 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:26:53 user nova-compute[74820]:       <mac address="fa:16:3e:2b:07:48"/>
Nov 08 18:26:53 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:26:53 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:26:53 user nova-compute[74820]:       <target dev="tap6d64d0e5-09"/>
Nov 08 18:26:53 user nova-compute[74820]:     </interface>
Nov 08 18:26:53 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:26:53 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/console.log" append="off"/>
Nov 08 18:26:53 user nova-compute[74820]:     </serial>
Nov 08 18:26:53 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:26:53 user nova-compute[74820]:     <video>
Nov 08 18:26:53 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:26:53 user nova-compute[74820]:     </video>
Nov 08 18:26:53 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:26:53 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:26:53 user nova-compute[74820]:     </rng>
Nov 08 18:26:53 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:26:53 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:26:53 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:26:53 user nova-compute[74820]:     </memballoon>
Nov 08 18:26:53 user nova-compute[74820]:   </devices>
Nov 08 18:26:53 user nova-compute[74820]: </domain>
Nov 08 18:26:53 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1644669325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1644669325',id=1,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-uwqjhdqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:47Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=3cbcbe67-7c9c-46a8-8617-85921d7fb83f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG os_vif [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Created schema index Interface.name {{(pid=74820) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Created schema index Port.name {{(pid=74820) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Created schema index Bridge.name {{(pid=74820) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [POLLOUT] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7de5fe67-4ccf-531f-9e5d-53cd00d4cea9', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:26:54 user nova-compute[74820]: INFO oslo.privsep.daemon [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp2t0rsym2/privsep.sock']
Nov 08 18:26:54 user sudo[84324]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp2t0rsym2/privsep.sock
Nov 08 18:26:54 user sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:26:54 user nova-compute[74820]: INFO nova.compute.claims [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Claim successful on node user
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.025s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:26:54 user nova-compute[74820]: INFO nova.compute.claims [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Claim successful on node user
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.network.neutron [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:26:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:26:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.policy [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a29988069fd43e0bfdb7b08a1fcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdef93b9fc745768902ae1afe39ae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:26:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Creating image(s)
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "/opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.008s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "/opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.454s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:26:55 user nova-compute[74820]: INFO nova.compute.claims [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Claim successful on node user
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.226s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:26:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.231s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk 1073741824" returned: 0 in 0.049s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:26:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Creating image(s)
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "/opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.policy [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecfee2b968614f47aa97aafd07b66548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f45aa33327417986332546abed6d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.373s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:55 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:26:55 user nova-compute[74820]: INFO nova.compute.claims [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Claim successful on node user
Nov 08 18:26:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.229s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user sudo[84324]: pam_unix(sudo:session): session closed for user root
Nov 08 18:26:56 user nova-compute[74820]: INFO oslo.privsep.daemon [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Spawned new privsep daemon via rootwrap
Nov 08 18:26:56 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 18:26:56 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 18:26:56 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 18:26:56 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84341
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:26:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Cannot resize image /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Ensure instance console log exists: /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk 1073741824" returned: 0 in 0.055s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:26:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Creating image(s)
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.network.neutron [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updated VIF entry in instance network info cache for port 6d64d0e5-098d-417c-873e-d2dcc1f57287. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.network.neutron [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.policy [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6adeab5384fc4d8fad36575d715cf133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c3b99ebc044d32a5647dc7963f11ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bf4a39d1-fd7b-4c29-bbae-957f172b3e5d req-d687b109-e40c-46c4-8a6e-5f7922471c48 service nova] Releasing lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:26:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d64d0e5-09, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d64d0e5-09, col_values=(('qos', UUID('c8528cb0-2f5e-4b75-90de-5d76231d48f8')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d64d0e5-09, col_values=(('external_ids', {'iface-id': '6d64d0e5-098d-417c-873e-d2dcc1f57287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:07:48', 'vm-uuid': '3cbcbe67-7c9c-46a8-8617-85921d7fb83f'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:56 user nova-compute[74820]: INFO os_vif [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09')
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Successfully created port: 5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Cannot resize image /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Ensure instance console log exists: /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:26:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Creating image(s)
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk 1073741824" returned: 0 in 0.054s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No VIF found with MAC fa:16:3e:2b:07:48, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG nova.policy [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d7a66f28dd1417980df3a2f3a64bc0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e230a1c67e924522b88cfc57decccb17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.209s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Cannot resize image /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Ensure instance console log exists: /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk 1073741824" returned: 0 in 0.092s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Cannot resize image /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Ensure instance console log exists: /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:26:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Successfully created port: 0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:26:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Successfully created port: 4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Successfully updated port: 5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Successfully created port: 85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.compute.manager [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-changed-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.compute.manager [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Refreshing instance network info cache due to event network-changed-5d03043b-6d05-4b75-beb0-4d59d95aeb6b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:26:59 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Instance spawned successfully.
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:26:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:00 user nova-compute[74820]: INFO nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Took 12.74 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:00 user nova-compute[74820]: INFO nova.compute.manager [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Took 13.87 seconds to build instance.
Nov 08 18:27:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ddd8b2e8-fc52-4a29-92ae-49f6bf3e0170 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.116s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Instance network_info: |[{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.neutron [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Refreshing network info cache for port 5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Start _get_guest_xml network_info=[{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:00 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:00 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-768372607',display_name='tempest-ServerActionsTestOtherA-server-768372607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-768372607',id=2,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-55br7gba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=3a96e438-f59b-48f9-badf-abf0baede2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.objects.instance [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a96e438-f59b-48f9-badf-abf0baede2ee {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:00 user nova-compute[74820]:   <uuid>3a96e438-f59b-48f9-badf-abf0baede2ee</uuid>
Nov 08 18:27:00 user nova-compute[74820]:   <name>instance-00000002</name>
Nov 08 18:27:00 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:00 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:00 user nova-compute[74820]:   <metadata>
Nov 08 18:27:00 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:00 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:00 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherA-server-768372607</nova:name>
Nov 08 18:27:00 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:00</nova:creationTime>
Nov 08 18:27:00 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:00 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:00 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:00 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:user uuid="1a29988069fd43e0bfdb7b08a1fcc5d9">tempest-ServerActionsTestOtherA-600897548-project-member</nova:user>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:project uuid="4cdef93b9fc745768902ae1afe39ae4a">tempest-ServerActionsTestOtherA-600897548</nova:project>
Nov 08 18:27:00 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:00 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:00 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:00 user nova-compute[74820]:         <nova:port uuid="5d03043b-6d05-4b75-beb0-4d59d95aeb6b">
Nov 08 18:27:00 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:27:00 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:00 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:00 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:00 user nova-compute[74820]:   </metadata>
Nov 08 18:27:00 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:00 user nova-compute[74820]:     <system>
Nov 08 18:27:00 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:00 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:00 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:00 user nova-compute[74820]:       <entry name="serial">3a96e438-f59b-48f9-badf-abf0baede2ee</entry>
Nov 08 18:27:00 user nova-compute[74820]:       <entry name="uuid">3a96e438-f59b-48f9-badf-abf0baede2ee</entry>
Nov 08 18:27:00 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:00 user nova-compute[74820]:     </system>
Nov 08 18:27:00 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:00 user nova-compute[74820]:   <os>
Nov 08 18:27:00 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:00 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:00 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:00 user nova-compute[74820]:   </os>
Nov 08 18:27:00 user nova-compute[74820]:   <features>
Nov 08 18:27:00 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:00 user nova-compute[74820]:     <apic/>
Nov 08 18:27:00 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:00 user nova-compute[74820]:   </features>
Nov 08 18:27:00 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:00 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:00 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:00 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:00 user nova-compute[74820]:   </clock>
Nov 08 18:27:00 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:00 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:00 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:00 user nova-compute[74820]:   </cpu>
Nov 08 18:27:00 user nova-compute[74820]:   <devices>
Nov 08 18:27:00 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:00 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:00 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk"/>
Nov 08 18:27:00 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:00 user nova-compute[74820]:     </disk>
Nov 08 18:27:00 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:00 user nova-compute[74820]:       <mac address="fa:16:3e:6f:a4:63"/>
Nov 08 18:27:00 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:00 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:00 user nova-compute[74820]:       <target dev="tap5d03043b-6d"/>
Nov 08 18:27:00 user nova-compute[74820]:     </interface>
Nov 08 18:27:00 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:00 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/console.log" append="off"/>
Nov 08 18:27:00 user nova-compute[74820]:     </serial>
Nov 08 18:27:00 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:00 user nova-compute[74820]:     <video>
Nov 08 18:27:00 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:00 user nova-compute[74820]:     </video>
Nov 08 18:27:00 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:00 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:00 user nova-compute[74820]:     </rng>
Nov 08 18:27:00 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:00 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:00 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:00 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:00 user nova-compute[74820]:   </devices>
Nov 08 18:27:00 user nova-compute[74820]: </domain>
Nov 08 18:27:00 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-768372607',display_name='tempest-ServerActionsTestOtherA-server-768372607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-768372607',id=2,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-55br7gba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=3a96e438-f59b-48f9-badf-abf0baede2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG os_vif [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da3d678d-eb9a-5691-aaf1-a6783210d0e0', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d03043b-6d, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d03043b-6d, col_values=(('qos', UUID('9ddc1b53-8367-42ce-b94f-d2c7f0ea6989')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d03043b-6d, col_values=(('external_ids', {'iface-id': '5d03043b-6d05-4b75-beb0-4d59d95aeb6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:a4:63', 'vm-uuid': '3a96e438-f59b-48f9-badf-abf0baede2ee'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:00 user nova-compute[74820]: INFO os_vif [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d')
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Successfully updated port: 0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No VIF found with MAC fa:16:3e:6f:a4:63, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-changed-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing instance network info cache due to event network-changed-0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Successfully updated port: 85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Successfully updated port: 4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquired lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-changed-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Refreshing instance network info cache due to event network-changed-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] Acquiring lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance network_info: |[{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Start _get_guest_xml network_info=[{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2024314283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2024314283',id=3,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg5ezgL7fDWQ0j/n0PZICZmy/N40SmvarZlg0lwj9ZxwPwrOi0ct8zDukLJqKXjIKyOJTAldRJwsA3bHrOhRGpdv9w2rDG4gi4E5jjouezEz1BjOl1yccMqb2+N4CIaEQ==',key_name='tempest-keypair-1409935399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-kk2xmpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=1f6a8436-ae6e-4edb-8046-baccf72c6560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.objects.instance [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:02 user nova-compute[74820]:   <uuid>1f6a8436-ae6e-4edb-8046-baccf72c6560</uuid>
Nov 08 18:27:02 user nova-compute[74820]:   <name>instance-00000003</name>
Nov 08 18:27:02 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:02 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:02 user nova-compute[74820]:   <metadata>
Nov 08 18:27:02 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:02 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2024314283</nova:name>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:02</nova:creationTime>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:02 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:02 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:user uuid="6adeab5384fc4d8fad36575d715cf133">tempest-AttachVolumeShelveTestJSON-1684933452-project-member</nova:user>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:project uuid="80c3b99ebc044d32a5647dc7963f11ae">tempest-AttachVolumeShelveTestJSON-1684933452</nova:project>
Nov 08 18:27:02 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:port uuid="0a750543-2d73-441e-82df-c608edcbea0a">
Nov 08 18:27:02 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 18:27:02 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:02 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:02 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:02 user nova-compute[74820]:   </metadata>
Nov 08 18:27:02 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:02 user nova-compute[74820]:     <system>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="serial">1f6a8436-ae6e-4edb-8046-baccf72c6560</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="uuid">1f6a8436-ae6e-4edb-8046-baccf72c6560</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:02 user nova-compute[74820]:     </system>
Nov 08 18:27:02 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:02 user nova-compute[74820]:   <os>
Nov 08 18:27:02 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:02 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:02 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:02 user nova-compute[74820]:   </os>
Nov 08 18:27:02 user nova-compute[74820]:   <features>
Nov 08 18:27:02 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:02 user nova-compute[74820]:     <apic/>
Nov 08 18:27:02 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:02 user nova-compute[74820]:   </features>
Nov 08 18:27:02 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:02 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:02 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:02 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:02 user nova-compute[74820]:   </clock>
Nov 08 18:27:02 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:02 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:02 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:02 user nova-compute[74820]:   </cpu>
Nov 08 18:27:02 user nova-compute[74820]:   <devices>
Nov 08 18:27:02 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:02 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:02 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk"/>
Nov 08 18:27:02 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:02 user nova-compute[74820]:     </disk>
Nov 08 18:27:02 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:02 user nova-compute[74820]:       <mac address="fa:16:3e:b7:83:e9"/>
Nov 08 18:27:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:02 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:02 user nova-compute[74820]:       <target dev="tap0a750543-2d"/>
Nov 08 18:27:02 user nova-compute[74820]:     </interface>
Nov 08 18:27:02 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:02 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/console.log" append="off"/>
Nov 08 18:27:02 user nova-compute[74820]:     </serial>
Nov 08 18:27:02 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:02 user nova-compute[74820]:     <video>
Nov 08 18:27:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:02 user nova-compute[74820]:     </video>
Nov 08 18:27:02 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:02 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:02 user nova-compute[74820]:     </rng>
Nov 08 18:27:02 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:02 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:02 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:02 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:02 user nova-compute[74820]:   </devices>
Nov 08 18:27:02 user nova-compute[74820]: </domain>
Nov 08 18:27:02 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2024314283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2024314283',id=3,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg5ezgL7fDWQ0j/n0PZICZmy/N40SmvarZlg0lwj9ZxwPwrOi0ct8zDukLJqKXjIKyOJTAldRJwsA3bHrOhRGpdv9w2rDG4gi4E5jjouezEz1BjOl1yccMqb2+N4CIaEQ==',key_name='tempest-keypair-1409935399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-kk2xmpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=1f6a8436-ae6e-4edb-8046-baccf72c6560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG os_vif [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ebb04ad-38b6-513f-aa18-a1c889ba26d9', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a750543-2d, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a750543-2d, col_values=(('qos', UUID('0106f4e9-3bf8-4448-956d-a2a6f1d75faa')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a750543-2d, col_values=(('external_ids', {'iface-id': '0a750543-2d73-441e-82df-c608edcbea0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:83:e9', 'vm-uuid': '1f6a8436-ae6e-4edb-8046-baccf72c6560'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: INFO os_vif [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d')
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No VIF found with MAC fa:16:3e:b7:83:e9, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updated VIF entry in instance network info cache for port 5d03043b-6d05-4b75-beb0-4d59d95aeb6b. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a162207c-c9a7-4271-b828-1376bf72c892 req-7925e050-7355-455c-b403-aff7fba173cb service nova] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updating instance_info_cache with network_info: [{"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Releasing lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Instance network_info: |[{"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] Acquired lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Refreshing network info cache for port 4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Start _get_guest_xml network_info=[{"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1037311916',display_name='tempest-AttachVolumeNegativeTest-server-1037311916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1037311916',id=4,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH63lXMeaDeAhRD1NTC7hyfSsYdQhE+1JMRONrstAd+7dj1mGLZrSv6JMcVjlG2zErGREK1lwXVoEzS9dZNN4AeziE030XZuhJJgAQ+kY9Ue1ERBrSsvGE1AbLuHvSv09Q==',key_name='tempest-keypair-2003508355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-0urs701a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=e55b6e6b-6928-407d-b147-aa912277ec71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'pci_devices' on Instance uuid e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:02 user nova-compute[74820]:   <uuid>e55b6e6b-6928-407d-b147-aa912277ec71</uuid>
Nov 08 18:27:02 user nova-compute[74820]:   <name>instance-00000004</name>
Nov 08 18:27:02 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:02 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:02 user nova-compute[74820]:   <metadata>
Nov 08 18:27:02 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:02 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1037311916</nova:name>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:02</nova:creationTime>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:02 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:02 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:user uuid="ecfee2b968614f47aa97aafd07b66548">tempest-AttachVolumeNegativeTest-657533753-project-member</nova:user>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:project uuid="d4f45aa33327417986332546abed6d92">tempest-AttachVolumeNegativeTest-657533753</nova:project>
Nov 08 18:27:02 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:02 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:02 user nova-compute[74820]:         <nova:port uuid="4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c">
Nov 08 18:27:02 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:27:02 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:02 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:02 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:02 user nova-compute[74820]:   </metadata>
Nov 08 18:27:02 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:02 user nova-compute[74820]:     <system>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="serial">e55b6e6b-6928-407d-b147-aa912277ec71</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="uuid">e55b6e6b-6928-407d-b147-aa912277ec71</entry>
Nov 08 18:27:02 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:02 user nova-compute[74820]:     </system>
Nov 08 18:27:02 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:02 user nova-compute[74820]:   <os>
Nov 08 18:27:02 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:02 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:02 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:02 user nova-compute[74820]:   </os>
Nov 08 18:27:02 user nova-compute[74820]:   <features>
Nov 08 18:27:02 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:02 user nova-compute[74820]:     <apic/>
Nov 08 18:27:02 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:02 user nova-compute[74820]:   </features>
Nov 08 18:27:02 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:02 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:02 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:02 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:02 user nova-compute[74820]:   </clock>
Nov 08 18:27:02 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:02 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:02 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:02 user nova-compute[74820]:   </cpu>
Nov 08 18:27:02 user nova-compute[74820]:   <devices>
Nov 08 18:27:02 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:02 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:02 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk"/>
Nov 08 18:27:02 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:02 user nova-compute[74820]:     </disk>
Nov 08 18:27:02 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:02 user nova-compute[74820]:       <mac address="fa:16:3e:28:1d:78"/>
Nov 08 18:27:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:02 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:02 user nova-compute[74820]:       <target dev="tap4f05462e-3c"/>
Nov 08 18:27:02 user nova-compute[74820]:     </interface>
Nov 08 18:27:02 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:02 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/console.log" append="off"/>
Nov 08 18:27:02 user nova-compute[74820]:     </serial>
Nov 08 18:27:02 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:02 user nova-compute[74820]:     <video>
Nov 08 18:27:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:02 user nova-compute[74820]:     </video>
Nov 08 18:27:02 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:02 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:02 user nova-compute[74820]:     </rng>
Nov 08 18:27:02 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:02 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:02 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:02 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:02 user nova-compute[74820]:   </devices>
Nov 08 18:27:02 user nova-compute[74820]: </domain>
Nov 08 18:27:02 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1037311916',display_name='tempest-AttachVolumeNegativeTest-server-1037311916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1037311916',id=4,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH63lXMeaDeAhRD1NTC7hyfSsYdQhE+1JMRONrstAd+7dj1mGLZrSv6JMcVjlG2zErGREK1lwXVoEzS9dZNN4AeziE030XZuhJJgAQ+kY9Ue1ERBrSsvGE1AbLuHvSv09Q==',key_name='tempest-keypair-2003508355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-0urs701a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=e55b6e6b-6928-407d-b147-aa912277ec71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG os_vif [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance network_info: |[{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c7586e4-0dac-5fc3-966c-1a984277867b', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start _get_guest_xml network_info=[{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'pci_devices' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f05462e-3c, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f05462e-3c, col_values=(('qos', UUID('8fbce8ff-4ef6-41a4-b32d-05ed13cb1a4d')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f05462e-3c, col_values=(('external_ids', {'iface-id': '4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:1d:78', 'vm-uuid': 'e55b6e6b-6928-407d-b147-aa912277ec71'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:03 user nova-compute[74820]:   <uuid>a19102f1-af5a-4cb1-876f-8d053abed70b</uuid>
Nov 08 18:27:03 user nova-compute[74820]:   <name>instance-00000005</name>
Nov 08 18:27:03 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:03 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:03 user nova-compute[74820]:   <metadata>
Nov 08 18:27:03 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:03 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:03 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherB-server-276469762</nova:name>
Nov 08 18:27:03 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:02</nova:creationTime>
Nov 08 18:27:03 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:03 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:03 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:03 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:user uuid="8d7a66f28dd1417980df3a2f3a64bc0e">tempest-ServerActionsTestOtherB-740424869-project-member</nova:user>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:project uuid="e230a1c67e924522b88cfc57decccb17">tempest-ServerActionsTestOtherB-740424869</nova:project>
Nov 08 18:27:03 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:03 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:03 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:03 user nova-compute[74820]:         <nova:port uuid="85125f2a-e0c8-4893-8e27-7036ee1bb847">
Nov 08 18:27:03 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:27:03 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:03 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:03 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:03 user nova-compute[74820]:   </metadata>
Nov 08 18:27:03 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:03 user nova-compute[74820]:     <system>
Nov 08 18:27:03 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:03 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:03 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:03 user nova-compute[74820]:       <entry name="serial">a19102f1-af5a-4cb1-876f-8d053abed70b</entry>
Nov 08 18:27:03 user nova-compute[74820]:       <entry name="uuid">a19102f1-af5a-4cb1-876f-8d053abed70b</entry>
Nov 08 18:27:03 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:03 user nova-compute[74820]:     </system>
Nov 08 18:27:03 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:03 user nova-compute[74820]:   <os>
Nov 08 18:27:03 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:03 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:03 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:03 user nova-compute[74820]:   </os>
Nov 08 18:27:03 user nova-compute[74820]:   <features>
Nov 08 18:27:03 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:03 user nova-compute[74820]:     <apic/>
Nov 08 18:27:03 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:03 user nova-compute[74820]:   </features>
Nov 08 18:27:03 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:03 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:03 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:03 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:03 user nova-compute[74820]:   </clock>
Nov 08 18:27:03 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:03 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:03 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:03 user nova-compute[74820]:   </cpu>
Nov 08 18:27:03 user nova-compute[74820]:   <devices>
Nov 08 18:27:03 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:03 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:03 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk"/>
Nov 08 18:27:03 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:03 user nova-compute[74820]:     </disk>
Nov 08 18:27:03 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:03 user nova-compute[74820]:       <mac address="fa:16:3e:33:c7:d1"/>
Nov 08 18:27:03 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:03 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:03 user nova-compute[74820]:       <target dev="tap85125f2a-e0"/>
Nov 08 18:27:03 user nova-compute[74820]:     </interface>
Nov 08 18:27:03 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:03 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/console.log" append="off"/>
Nov 08 18:27:03 user nova-compute[74820]:     </serial>
Nov 08 18:27:03 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:03 user nova-compute[74820]:     <video>
Nov 08 18:27:03 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:03 user nova-compute[74820]:     </video>
Nov 08 18:27:03 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:03 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:03 user nova-compute[74820]:     </rng>
Nov 08 18:27:03 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:03 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:03 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:03 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:03 user nova-compute[74820]:   </devices>
Nov 08 18:27:03 user nova-compute[74820]: </domain>
Nov 08 18:27:03 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG os_vif [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: INFO os_vif [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c')
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '532370fb-be92-5fb5-97c0-d2ab2c7d0977', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85125f2a-e0, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85125f2a-e0, col_values=(('qos', UUID('22677baa-ce17-4283-aeab-35050a59333c')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85125f2a-e0, col_values=(('external_ids', {'iface-id': '85125f2a-e0c8-4893-8e27-7036ee1bb847', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c7:d1', 'vm-uuid': 'a19102f1-af5a-4cb1-876f-8d053abed70b'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-changed-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Refreshing instance network info cache due to event network-changed-85125f2a-e0c8-4893-8e27-7036ee1bb847. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.network.neutron [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Refreshing network info cache for port 85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:03 user nova-compute[74820]: INFO os_vif [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0')
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No VIF found with MAC fa:16:3e:28:1d:78, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No VIF found with MAC fa:16:3e:33:c7:d1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updated VIF entry in instance network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-21c18bda-6071-487b-833f-9c8f690928a4 req-8cf74e02-3523-4650-ba6f-374f23147ddf service nova] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updated VIF entry in instance network info cache for port 85125f2a-e0c8-4893-8e27-7036ee1bb847. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63baefac-fa42-4ff7-bbf4-ae61061cccd4 req-f0430d09-25cb-4a38-8b42-df6b6ad38594 service nova] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updated VIF entry in instance network info cache for port 4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updating instance_info_cache with network_info: [{"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d328eb21-9b5f-45a7-a2ce-710bc5662ebf req-ce98fcae-6bac-4aa0-add8-be0f4fc0a2fa service nova] Releasing lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-09b4b9ed-326c-47dd-a8e2-e5c5e4037512 req-7918eb13-5734-4287-9f4e-3c33b86f4c35 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-09b4b9ed-326c-47dd-a8e2-e5c5e4037512 req-7918eb13-5734-4287-9f4e-3c33b86f4c35 service nova] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-09b4b9ed-326c-47dd-a8e2-e5c5e4037512 req-7918eb13-5734-4287-9f4e-3c33b86f4c35 service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-09b4b9ed-326c-47dd-a8e2-e5c5e4037512 req-7918eb13-5734-4287-9f4e-3c33b86f4c35 service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-09b4b9ed-326c-47dd-a8e2-e5c5e4037512 req-7918eb13-5734-4287-9f4e-3c33b86f4c35 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] No waiting events found dispatching network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:07 user nova-compute[74820]: WARNING nova.compute.manager [req-09b4b9ed-326c-47dd-a8e2-e5c5e4037512 req-7918eb13-5734-4287-9f4e-3c33b86f4c35 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received unexpected event network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 for instance with vm_state active and task_state None.
Nov 08 18:27:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Instance spawned successfully.
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:09 user nova-compute[74820]: INFO nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Took 13.87 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:09 user nova-compute[74820]: INFO nova.compute.manager [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Took 15.16 seconds to build instance.
Nov 08 18:27:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-357bb92a-6d8f-4c8f-ad1a-ea1973157d28 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.597s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] No waiting events found dispatching network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:10 user nova-compute[74820]: WARNING nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received unexpected event network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 for instance with vm_state active and task_state None.
Nov 08 18:27:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] No waiting events found dispatching network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:10 user nova-compute[74820]: WARNING nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received unexpected event network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c for instance with vm_state building and task_state spawning.
Nov 08 18:27:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] No waiting events found dispatching network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:10 user nova-compute[74820]: WARNING nova.compute.manager [req-0c61cfeb-a859-49d6-a395-b91b7ed216e5 req-98b271f9-13c0-4177-84ea-791bd9d154a5 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received unexpected event network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c for instance with vm_state building and task_state spawning.
Nov 08 18:27:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance spawned successfully.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Instance spawned successfully.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance spawned successfully.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Took 15.01 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Took 14.63 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Took 15.71 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.compute.manager [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Took 16.02 seconds to build instance.
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.compute.manager [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Took 16.71 seconds to build instance.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0cbeed8d-82ab-46c2-8a44-09d09e155a7f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.274s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5b604ec3-b218-4ab0-a1d8-f5fe0e0f93cb tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.011s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:11 user nova-compute[74820]: INFO nova.compute.manager [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Took 17.07 seconds to build instance.
Nov 08 18:27:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a5f29b5-ae0e-4253-8ebf-0bdd613ac0c3 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.272s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:27:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:14 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:27:14 user nova-compute[74820]: INFO nova.compute.claims [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Claim successful on node user
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:27:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:27:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:27:15 user nova-compute[74820]: DEBUG nova.policy [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e92151f626b44a96b7974667d9e62217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56aa0d597f4404fbbe0da7ee83cb9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:27:16 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Creating image(s)
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "/opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "/opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "/opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "58edf425191bc3848d997a755c0d2d7c09e0eeac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "58edf425191bc3848d997a755c0d2d7c09e0eeac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.part --force-share --output=json" returned: 0 in 0.320s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG nova.virt.images [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] d0463fd2-557b-4320-a9a6-ac1c8c1024ed was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:27:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.part /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.part /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.converted" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac.converted --force-share --output=json" returned: 0 in 0.242s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "58edf425191bc3848d997a755c0d2d7c09e0eeac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.272s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Successfully created port: b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "58edf425191bc3848d997a755c0d2d7c09e0eeac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "58edf425191bc3848d997a755c0d2d7c09e0eeac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac --force-share --output=json" returned: 0 in 0.287s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac,backing_fmt=raw /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac,backing_fmt=raw /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk 1073741824" returned: 0 in 0.071s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "58edf425191bc3848d997a755c0d2d7c09e0eeac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac --force-share --output=json" returned: 0 in 0.232s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Successfully updated port: b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquired lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-changed-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Refreshing instance network info cache due to event network-changed-b9cf1ca9-4e85-46fd-93b1-f5a68165949c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] Acquiring lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Cannot resize image /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Ensure instance console log exists: /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updating instance_info_cache with network_info: [{"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Releasing lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Instance network_info: |[{"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] Acquired lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.neutron [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Refreshing network info cache for port b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Start _get_guest_xml network_info=[{"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:27:05Z,direct_url=<?>,disk_format='qcow2',id=d0463fd2-557b-4320-a9a6-ac1c8c1024ed,min_disk=0,min_ram=0,name='',owner='8d420351054d43c99d144a492c977ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_options': None, 'image_id': 'd0463fd2-557b-4320-a9a6-ac1c8c1024ed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:18 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:18 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:27:05Z,direct_url=<?>,disk_format='qcow2',id=d0463fd2-557b-4320-a9a6-ac1c8c1024ed,min_disk=0,min_ram=0,name='',owner='8d420351054d43c99d144a492c977ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-842160497',display_name='tempest-AttachSCSIVolumeTestJSON-server-842160497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-842160497',id=6,image_ref='d0463fd2-557b-4320-a9a6-ac1c8c1024ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLgO9gtrtjMO0xyB3Y10buR5MAi4T2fio6wYyYdIxTmeUy3qOXzjV4T05TkANv5zJErpoL3G+yZ5+JZAFXp+ANwzGc/DHkN8MZJSxDWlPDEGeCcOczPPmFmWDYQ94Twgw==',key_name='tempest-keypair-1665980508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56aa0d597f4404fbbe0da7ee83cb9ca',ramdisk_id='',reservation_id='r-ut1m4dei',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d0463fd2-557b-4320-a9a6-ac1c8c1024ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-781876229',owner_user_name='tempest-AttachSCSIVolumeTestJSON-781876229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e92151f626b44a96b7974667d9e62217',uuid=818ce0ba-7664-4625-9cc9-45a46d4a2e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Converting VIF {"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lazy-loading 'pci_devices' on Instance uuid 818ce0ba-7664-4625-9cc9-45a46d4a2e02 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:18 user nova-compute[74820]:   <uuid>818ce0ba-7664-4625-9cc9-45a46d4a2e02</uuid>
Nov 08 18:27:18 user nova-compute[74820]:   <name>instance-00000006</name>
Nov 08 18:27:18 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:18 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:18 user nova-compute[74820]:   <metadata>
Nov 08 18:27:18 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:18 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:18 user nova-compute[74820]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-842160497</nova:name>
Nov 08 18:27:18 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:18</nova:creationTime>
Nov 08 18:27:18 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:18 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:18 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:18 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:user uuid="e92151f626b44a96b7974667d9e62217">tempest-AttachSCSIVolumeTestJSON-781876229-project-member</nova:user>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:project uuid="f56aa0d597f4404fbbe0da7ee83cb9ca">tempest-AttachSCSIVolumeTestJSON-781876229</nova:project>
Nov 08 18:27:18 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:18 user nova-compute[74820]:       <nova:root type="image" uuid="d0463fd2-557b-4320-a9a6-ac1c8c1024ed"/>
Nov 08 18:27:18 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:18 user nova-compute[74820]:         <nova:port uuid="b9cf1ca9-4e85-46fd-93b1-f5a68165949c">
Nov 08 18:27:18 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 18:27:18 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:18 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:18 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:18 user nova-compute[74820]:   </metadata>
Nov 08 18:27:18 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:18 user nova-compute[74820]:     <system>
Nov 08 18:27:18 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:18 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:18 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:18 user nova-compute[74820]:       <entry name="serial">818ce0ba-7664-4625-9cc9-45a46d4a2e02</entry>
Nov 08 18:27:18 user nova-compute[74820]:       <entry name="uuid">818ce0ba-7664-4625-9cc9-45a46d4a2e02</entry>
Nov 08 18:27:18 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:18 user nova-compute[74820]:     </system>
Nov 08 18:27:18 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:18 user nova-compute[74820]:   <os>
Nov 08 18:27:18 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:18 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:18 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:18 user nova-compute[74820]:   </os>
Nov 08 18:27:18 user nova-compute[74820]:   <features>
Nov 08 18:27:18 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:18 user nova-compute[74820]:     <apic/>
Nov 08 18:27:18 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:18 user nova-compute[74820]:   </features>
Nov 08 18:27:18 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:18 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:18 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:18 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:18 user nova-compute[74820]:   </clock>
Nov 08 18:27:18 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:18 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:18 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:18 user nova-compute[74820]:   </cpu>
Nov 08 18:27:18 user nova-compute[74820]:   <devices>
Nov 08 18:27:18 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:18 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:18 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk"/>
Nov 08 18:27:18 user nova-compute[74820]:       <target dev="sda" bus="scsi"/>
Nov 08 18:27:18 user nova-compute[74820]:       <address type="drive" controller="0" unit="0"/>
Nov 08 18:27:18 user nova-compute[74820]:     </disk>
Nov 08 18:27:18 user nova-compute[74820]:     <disk type="file" device="cdrom">
Nov 08 18:27:18 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 18:27:18 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.config"/>
Nov 08 18:27:18 user nova-compute[74820]:       <target dev="sdb" bus="scsi"/>
Nov 08 18:27:18 user nova-compute[74820]:       <address type="drive" controller="0" unit="1"/>
Nov 08 18:27:18 user nova-compute[74820]:     </disk>
Nov 08 18:27:18 user nova-compute[74820]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 18:27:18 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:18 user nova-compute[74820]:       <mac address="fa:16:3e:e3:c9:38"/>
Nov 08 18:27:18 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:18 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:18 user nova-compute[74820]:       <target dev="tapb9cf1ca9-4e"/>
Nov 08 18:27:18 user nova-compute[74820]:     </interface>
Nov 08 18:27:18 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:18 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/console.log" append="off"/>
Nov 08 18:27:18 user nova-compute[74820]:     </serial>
Nov 08 18:27:18 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:18 user nova-compute[74820]:     <video>
Nov 08 18:27:18 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:18 user nova-compute[74820]:     </video>
Nov 08 18:27:18 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:18 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:18 user nova-compute[74820]:     </rng>
Nov 08 18:27:18 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:18 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:18 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:18 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:18 user nova-compute[74820]:   </devices>
Nov 08 18:27:18 user nova-compute[74820]: </domain>
Nov 08 18:27:18 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-842160497',display_name='tempest-AttachSCSIVolumeTestJSON-server-842160497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-842160497',id=6,image_ref='d0463fd2-557b-4320-a9a6-ac1c8c1024ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLgO9gtrtjMO0xyB3Y10buR5MAi4T2fio6wYyYdIxTmeUy3qOXzjV4T05TkANv5zJErpoL3G+yZ5+JZAFXp+ANwzGc/DHkN8MZJSxDWlPDEGeCcOczPPmFmWDYQ94Twgw==',key_name='tempest-keypair-1665980508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f56aa0d597f4404fbbe0da7ee83cb9ca',ramdisk_id='',reservation_id='r-ut1m4dei',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d0463fd2-557b-4320-a9a6-ac1c8c1024ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-781876229',owner_user_name='tempest-AttachSCSIVolumeTestJSON-781876229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e92151f626b44a96b7974667d9e62217',uuid=818ce0ba-7664-4625-9cc9-45a46d4a2e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Converting VIF {"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG os_vif [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1b669d1-8c40-5551-b769-81843afdff6c', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9cf1ca9-4e, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9cf1ca9-4e, col_values=(('qos', UUID('9c2c9b8f-4d9f-42d4-8e4e-708d7c34a68a')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9cf1ca9-4e, col_values=(('external_ids', {'iface-id': 'b9cf1ca9-4e85-46fd-93b1-f5a68165949c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:c9:38', 'vm-uuid': '818ce0ba-7664-4625-9cc9-45a46d4a2e02'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:19 user nova-compute[74820]: INFO os_vif [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e')
Nov 08 18:27:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No BDM found with device name sda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No VIF found with MAC fa:16:3e:e3:c9:38, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Using config drive
Nov 08 18:27:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updated VIF entry in instance network info cache for port b9cf1ca9-4e85-46fd-93b1-f5a68165949c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updating instance_info_cache with network_info: [{"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dbb04dfa-7295-48a3-81c9-4cf36d6627bd req-d297cf40-5a92-4c68-a8a5-ab1eac92b695 service nova] Releasing lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Creating config drive at /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.config
Nov 08 18:27:19 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2_ml_m8t {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:19 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2_ml_m8t" returned: 0 in 0.070s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Instance spawned successfully.
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:24 user nova-compute[74820]: INFO nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Took 8.04 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:24 user nova-compute[74820]: INFO nova.compute.manager [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Took 9.41 seconds to build instance.
Nov 08 18:27:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2a677fa2-c0b4-48ce-8d1c-78aedb00ade3 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.623s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:27:25 user nova-compute[74820]: INFO nova.compute.claims [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Claim successful on node user
Nov 08 18:27:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:27:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:27:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG nova.policy [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bba75245b8d34d669ab6a0faa6c40330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e1f2856b5a49b9b23dedc7f4e0ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:27:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Creating image(s)
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.236s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk 1073741824" returned: 0 in 0.059s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.213s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Cannot resize image /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Ensure instance console log exists: /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Successfully created port: 7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:27:27 user nova-compute[74820]: INFO nova.compute.claims [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Claim successful on node user
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Successfully updated port: 7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-changed-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Refreshing instance network info cache due to event network-changed-7c540edf-72b4-4381-a2fb-48cc243f9449. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.policy [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebfb883dea294af0bf2a3981caaf076a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51037b9fc03482290b870aed2a7300d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:27:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Creating image(s)
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "/opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "/opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "/opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Instance network_info: |[{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.network.neutron [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Refreshing network info cache for port 7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Start _get_guest_xml network_info=[{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:28 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:28 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.objects.instance [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'pci_devices' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:29 user nova-compute[74820]:   <uuid>a2eddce3-e832-4737-be16-6d6a6ba7dc77</uuid>
Nov 08 18:27:29 user nova-compute[74820]:   <name>instance-00000007</name>
Nov 08 18:27:29 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:29 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:29 user nova-compute[74820]:   <metadata>
Nov 08 18:27:29 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:29 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:29 user nova-compute[74820]:       <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:27:29 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:28</nova:creationTime>
Nov 08 18:27:29 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:29 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:29 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:29 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:27:29 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:29 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:29 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:29 user nova-compute[74820]:         <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:27:29 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:27:29 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:29 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:29 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:29 user nova-compute[74820]:   </metadata>
Nov 08 18:27:29 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:29 user nova-compute[74820]:     <system>
Nov 08 18:27:29 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:29 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:29 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:29 user nova-compute[74820]:       <entry name="serial">a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:27:29 user nova-compute[74820]:       <entry name="uuid">a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:27:29 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:29 user nova-compute[74820]:     </system>
Nov 08 18:27:29 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:29 user nova-compute[74820]:   <os>
Nov 08 18:27:29 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:29 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:29 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:29 user nova-compute[74820]:   </os>
Nov 08 18:27:29 user nova-compute[74820]:   <features>
Nov 08 18:27:29 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:29 user nova-compute[74820]:     <apic/>
Nov 08 18:27:29 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:29 user nova-compute[74820]:   </features>
Nov 08 18:27:29 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:29 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:29 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:29 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:29 user nova-compute[74820]:   </clock>
Nov 08 18:27:29 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:29 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:29 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:29 user nova-compute[74820]:   </cpu>
Nov 08 18:27:29 user nova-compute[74820]:   <devices>
Nov 08 18:27:29 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:29 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:29 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk"/>
Nov 08 18:27:29 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:29 user nova-compute[74820]:     </disk>
Nov 08 18:27:29 user nova-compute[74820]:     <disk type="file" device="cdrom">
Nov 08 18:27:29 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 18:27:29 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config"/>
Nov 08 18:27:29 user nova-compute[74820]:       <target dev="hda" bus="ide"/>
Nov 08 18:27:29 user nova-compute[74820]:     </disk>
Nov 08 18:27:29 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:29 user nova-compute[74820]:       <mac address="fa:16:3e:f5:43:e0"/>
Nov 08 18:27:29 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:29 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:29 user nova-compute[74820]:       <target dev="tap7c540edf-72"/>
Nov 08 18:27:29 user nova-compute[74820]:     </interface>
Nov 08 18:27:29 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:29 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log" append="off"/>
Nov 08 18:27:29 user nova-compute[74820]:     </serial>
Nov 08 18:27:29 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:29 user nova-compute[74820]:     <video>
Nov 08 18:27:29 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:29 user nova-compute[74820]:     </video>
Nov 08 18:27:29 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:29 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:29 user nova-compute[74820]:     </rng>
Nov 08 18:27:29 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:29 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:29 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:29 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:29 user nova-compute[74820]:   </devices>
Nov 08 18:27:29 user nova-compute[74820]: </domain>
Nov 08 18:27:29 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG os_vif [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f3c6601-f69c-5c5f-a5b5-fd81721f49d7', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.261s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk 1073741824" returned: 0 in 0.077s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c540edf-72, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c540edf-72, col_values=(('qos', UUID('65b3e9e1-6650-4217-89e2-853f15414d16')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c540edf-72, col_values=(('external_ids', {'iface-id': '7c540edf-72b4-4381-a2fb-48cc243f9449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:43:e0', 'vm-uuid': 'a2eddce3-e832-4737-be16-6d6a6ba7dc77'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: INFO os_vif [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72')
Nov 08 18:27:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No BDM found with device name hda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No VIF found with MAC fa:16:3e:f5:43:e0, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Using config drive
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.264s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:27:29 user nova-compute[74820]: INFO nova.compute.claims [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Claim successful on node user
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Successfully created port: 6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Cannot resize image /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Ensure instance console log exists: /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Creating config drive at /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjjijgn8e {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.neutron [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updated VIF entry in instance network info cache for port 7c540edf-72b4-4381-a2fb-48cc243f9449. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG nova.network.neutron [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-39ae4925-8017-47e3-bb21-51647f3ef9f5 req-1d06fe83-e846-442b-a3d3-beace3e7bf7b service nova] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjjijgn8e" returned: 0 in 0.078s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:27:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.policy [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24abb824ef2f4ee9a37c19a36fd98127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292b3d04a2a64d65a673b680c0cb2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:27:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Creating image(s)
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "/opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "/opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "/opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Successfully updated port: 6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquired lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-changed-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Refreshing instance network info cache due to event network-changed-6be3d780-e87b-4b09-8e2c-7faca121591b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] Acquiring lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.242s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.210s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk 1073741824" returned: 0 in 0.056s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating instance_info_cache with network_info: [{"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Releasing lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Instance network_info: |[{"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] Acquired lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Refreshing network info cache for port 6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Start _get_guest_xml network_info=[{"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:31 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:31 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Successfully created port: 33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1990631977',display_name='tempest-TestVolumeSwap-server-1990631977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1990631977',id=8,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzdfAC7+fCun4ikLo5SooF37IOxncJEblawTjt1TPzMHh+JskkZEgh5bjKBX8mHg3OrLXPTnJg2LHlQqncErpc1YTvNgbWQF/8vNhu4d/3CrMdSA3iZAN2K3NuGTQjgQ==',key_name='tempest-keypair-1961683100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b51037b9fc03482290b870aed2a7300d',ramdisk_id='',reservation_id='r-mqssyy0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2056200727',owner_user_name='tempest-TestVolumeSwap-2056200727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebfb883dea294af0bf2a3981caaf076a',uuid=133d6dc8-9328-4831-a247-d655d91d32a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Converting VIF {"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lazy-loading 'pci_devices' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:31 user nova-compute[74820]:   <uuid>133d6dc8-9328-4831-a247-d655d91d32a9</uuid>
Nov 08 18:27:31 user nova-compute[74820]:   <name>instance-00000008</name>
Nov 08 18:27:31 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:31 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:31 user nova-compute[74820]:   <metadata>
Nov 08 18:27:31 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:31 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:31 user nova-compute[74820]:       <nova:name>tempest-TestVolumeSwap-server-1990631977</nova:name>
Nov 08 18:27:31 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:31</nova:creationTime>
Nov 08 18:27:31 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:31 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:31 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:31 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:user uuid="ebfb883dea294af0bf2a3981caaf076a">tempest-TestVolumeSwap-2056200727-project-member</nova:user>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:project uuid="b51037b9fc03482290b870aed2a7300d">tempest-TestVolumeSwap-2056200727</nova:project>
Nov 08 18:27:31 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:31 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:31 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:31 user nova-compute[74820]:         <nova:port uuid="6be3d780-e87b-4b09-8e2c-7faca121591b">
Nov 08 18:27:31 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:27:31 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:31 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:31 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:31 user nova-compute[74820]:   </metadata>
Nov 08 18:27:31 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:31 user nova-compute[74820]:     <system>
Nov 08 18:27:31 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:31 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:31 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:31 user nova-compute[74820]:       <entry name="serial">133d6dc8-9328-4831-a247-d655d91d32a9</entry>
Nov 08 18:27:31 user nova-compute[74820]:       <entry name="uuid">133d6dc8-9328-4831-a247-d655d91d32a9</entry>
Nov 08 18:27:31 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:31 user nova-compute[74820]:     </system>
Nov 08 18:27:31 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:31 user nova-compute[74820]:   <os>
Nov 08 18:27:31 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:31 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:31 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:31 user nova-compute[74820]:   </os>
Nov 08 18:27:31 user nova-compute[74820]:   <features>
Nov 08 18:27:31 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:31 user nova-compute[74820]:     <apic/>
Nov 08 18:27:31 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:31 user nova-compute[74820]:   </features>
Nov 08 18:27:31 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:31 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:31 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:31 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:31 user nova-compute[74820]:   </clock>
Nov 08 18:27:31 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:31 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:31 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:31 user nova-compute[74820]:   </cpu>
Nov 08 18:27:31 user nova-compute[74820]:   <devices>
Nov 08 18:27:31 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:31 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:31 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk"/>
Nov 08 18:27:31 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:31 user nova-compute[74820]:     </disk>
Nov 08 18:27:31 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:31 user nova-compute[74820]:       <mac address="fa:16:3e:ab:ac:9f"/>
Nov 08 18:27:31 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:31 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:31 user nova-compute[74820]:       <target dev="tap6be3d780-e8"/>
Nov 08 18:27:31 user nova-compute[74820]:     </interface>
Nov 08 18:27:31 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:31 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/console.log" append="off"/>
Nov 08 18:27:31 user nova-compute[74820]:     </serial>
Nov 08 18:27:31 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:31 user nova-compute[74820]:     <video>
Nov 08 18:27:31 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:31 user nova-compute[74820]:     </video>
Nov 08 18:27:31 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:31 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:31 user nova-compute[74820]:     </rng>
Nov 08 18:27:31 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:31 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:31 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:31 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:31 user nova-compute[74820]:   </devices>
Nov 08 18:27:31 user nova-compute[74820]: </domain>
Nov 08 18:27:31 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1990631977',display_name='tempest-TestVolumeSwap-server-1990631977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1990631977',id=8,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzdfAC7+fCun4ikLo5SooF37IOxncJEblawTjt1TPzMHh+JskkZEgh5bjKBX8mHg3OrLXPTnJg2LHlQqncErpc1YTvNgbWQF/8vNhu4d/3CrMdSA3iZAN2K3NuGTQjgQ==',key_name='tempest-keypair-1961683100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b51037b9fc03482290b870aed2a7300d',ramdisk_id='',reservation_id='r-mqssyy0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2056200727',owner_user_name='tempest-TestVolumeSwap-2056200727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebfb883dea294af0bf2a3981caaf076a',uuid=133d6dc8-9328-4831-a247-d655d91d32a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Converting VIF {"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG os_vif [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abe714a9-8340-515a-9101-3b0e66d92a56', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.234s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6be3d780-e8, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6be3d780-e8, col_values=(('qos', UUID('da4dc9b2-4cc5-43a6-adad-90d2a5de354d')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6be3d780-e8, col_values=(('external_ids', {'iface-id': '6be3d780-e87b-4b09-8e2c-7faca121591b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ac:9f', 'vm-uuid': '133d6dc8-9328-4831-a247-d655d91d32a9'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: INFO os_vif [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8')
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] No VIF found with MAC fa:16:3e:ab:ac:9f, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Cannot resize image /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Ensure instance console log exists: /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updated VIF entry in instance network info cache for port 6be3d780-e87b-4b09-8e2c-7faca121591b. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating instance_info_cache with network_info: [{"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cdc5b36-f5ca-4255-ace1-b5e5113f8a01 req-6d00c038-2c6c-4d32-b8f7-eff2c2925645 service nova] Releasing lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-535e43f8-f775-4672-91c6-595017fa87dd req-3c7ed227-8695-43ee-9c29-acc73cf5593a service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-535e43f8-f775-4672-91c6-595017fa87dd req-3c7ed227-8695-43ee-9c29-acc73cf5593a service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-535e43f8-f775-4672-91c6-595017fa87dd req-3c7ed227-8695-43ee-9c29-acc73cf5593a service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-535e43f8-f775-4672-91c6-595017fa87dd req-3c7ed227-8695-43ee-9c29-acc73cf5593a service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-535e43f8-f775-4672-91c6-595017fa87dd req-3c7ed227-8695-43ee-9c29-acc73cf5593a service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:31 user nova-compute[74820]: WARNING nova.compute.manager [req-535e43f8-f775-4672-91c6-595017fa87dd req-3c7ed227-8695-43ee-9c29-acc73cf5593a service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 for instance with vm_state building and task_state spawning.
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Successfully updated port: 33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquired lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:32 user nova-compute[74820]: WARNING nova.compute.manager [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received unexpected event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with vm_state active and task_state None.
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:32 user nova-compute[74820]: WARNING nova.compute.manager [req-63ab2939-0042-46e4-918d-bddd7e469f0a req-9492aea8-5d19-4679-9ed2-6b7f34101c93 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received unexpected event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with vm_state active and task_state None.
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updating instance_info_cache with network_info: [{"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Releasing lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Instance network_info: |[{"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Start _get_guest_xml network_info=[{"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:27:32 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:32 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:27:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1961637594',display_name='tempest-VolumesAssistedSnapshotsTest-server-1961637594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1961637594',id=9,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOq1nCn//Uk47KU39ssA5smYtK7mPFFFcJs1qlzE4FtrhNpbSf7TBgXxzuauUQVkpaIKOXDG5qZ2FOpDomeceKHCiiF6hYCJoXSHIvIL/X3RNP0/lHrSW7QpY8hgYRzHw==',key_name='tempest-keypair-1559265386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292b3d04a2a64d65a673b680c0cb2a6e',ramdisk_id='',reservation_id='r-kqgbyezq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-902008966',owner_user_name='tempest-VolumesAssistedSnapshotsTest-902008966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24abb824ef2f4ee9a37c19a36fd98127',uuid=c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Converting VIF {"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lazy-loading 'pci_devices' on Instance uuid c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:27:32 user nova-compute[74820]:   <uuid>c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9</uuid>
Nov 08 18:27:32 user nova-compute[74820]:   <name>instance-00000009</name>
Nov 08 18:27:32 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:27:32 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:27:32 user nova-compute[74820]:   <metadata>
Nov 08 18:27:32 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:27:32 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:27:32 user nova-compute[74820]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1961637594</nova:name>
Nov 08 18:27:32 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:27:32</nova:creationTime>
Nov 08 18:27:32 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:27:32 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:27:32 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:27:32 user nova-compute[74820]:       <nova:owner>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:user uuid="24abb824ef2f4ee9a37c19a36fd98127">tempest-VolumesAssistedSnapshotsTest-902008966-project-member</nova:user>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:project uuid="292b3d04a2a64d65a673b680c0cb2a6e">tempest-VolumesAssistedSnapshotsTest-902008966</nova:project>
Nov 08 18:27:32 user nova-compute[74820]:       </nova:owner>
Nov 08 18:27:32 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:27:32 user nova-compute[74820]:       <nova:ports>
Nov 08 18:27:32 user nova-compute[74820]:         <nova:port uuid="33dc19fe-a1fb-4820-b95a-98605ad9c595">
Nov 08 18:27:32 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 18:27:32 user nova-compute[74820]:         </nova:port>
Nov 08 18:27:32 user nova-compute[74820]:       </nova:ports>
Nov 08 18:27:32 user nova-compute[74820]:     </nova:instance>
Nov 08 18:27:32 user nova-compute[74820]:   </metadata>
Nov 08 18:27:32 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:27:32 user nova-compute[74820]:     <system>
Nov 08 18:27:32 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:27:32 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:27:32 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:27:32 user nova-compute[74820]:       <entry name="serial">c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9</entry>
Nov 08 18:27:32 user nova-compute[74820]:       <entry name="uuid">c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9</entry>
Nov 08 18:27:32 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:27:32 user nova-compute[74820]:     </system>
Nov 08 18:27:32 user nova-compute[74820]:   </sysinfo>
Nov 08 18:27:32 user nova-compute[74820]:   <os>
Nov 08 18:27:32 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:27:32 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:27:32 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:27:32 user nova-compute[74820]:   </os>
Nov 08 18:27:32 user nova-compute[74820]:   <features>
Nov 08 18:27:32 user nova-compute[74820]:     <acpi/>
Nov 08 18:27:32 user nova-compute[74820]:     <apic/>
Nov 08 18:27:32 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:27:32 user nova-compute[74820]:   </features>
Nov 08 18:27:32 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:27:32 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:27:32 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:27:32 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:27:32 user nova-compute[74820]:   </clock>
Nov 08 18:27:32 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:27:32 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:27:32 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:27:32 user nova-compute[74820]:   </cpu>
Nov 08 18:27:32 user nova-compute[74820]:   <devices>
Nov 08 18:27:32 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:27:32 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:27:32 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk"/>
Nov 08 18:27:32 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:27:32 user nova-compute[74820]:     </disk>
Nov 08 18:27:32 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:27:32 user nova-compute[74820]:       <mac address="fa:16:3e:48:d8:9a"/>
Nov 08 18:27:32 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:32 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:27:32 user nova-compute[74820]:       <target dev="tap33dc19fe-a1"/>
Nov 08 18:27:32 user nova-compute[74820]:     </interface>
Nov 08 18:27:32 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:27:32 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/console.log" append="off"/>
Nov 08 18:27:32 user nova-compute[74820]:     </serial>
Nov 08 18:27:32 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:27:32 user nova-compute[74820]:     <video>
Nov 08 18:27:32 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:27:32 user nova-compute[74820]:     </video>
Nov 08 18:27:32 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:27:32 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:27:32 user nova-compute[74820]:     </rng>
Nov 08 18:27:32 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:27:32 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:27:32 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:27:32 user nova-compute[74820]:     </memballoon>
Nov 08 18:27:32 user nova-compute[74820]:   </devices>
Nov 08 18:27:32 user nova-compute[74820]: </domain>
Nov 08 18:27:32 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:27:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1961637594',display_name='tempest-VolumesAssistedSnapshotsTest-server-1961637594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1961637594',id=9,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOq1nCn//Uk47KU39ssA5smYtK7mPFFFcJs1qlzE4FtrhNpbSf7TBgXxzuauUQVkpaIKOXDG5qZ2FOpDomeceKHCiiF6hYCJoXSHIvIL/X3RNP0/lHrSW7QpY8hgYRzHw==',key_name='tempest-keypair-1559265386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='292b3d04a2a64d65a673b680c0cb2a6e',ramdisk_id='',reservation_id='r-kqgbyezq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-902008966',owner_user_name='tempest-VolumesAssistedSnapshotsTest-902008966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:27:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24abb824ef2f4ee9a37c19a36fd98127',uuid=c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Converting VIF {"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG os_vif [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a149db7-2678-55aa-95df-68e522a8ca89', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33dc19fe-a1, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33dc19fe-a1, col_values=(('qos', UUID('683c452c-82c6-421c-b6b3-a90c37be9423')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33dc19fe-a1, col_values=(('external_ids', {'iface-id': '33dc19fe-a1fb-4820-b95a-98605ad9c595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:d8:9a', 'vm-uuid': 'c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:32 user nova-compute[74820]: INFO os_vif [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1')
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:27:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] No VIF found with MAC fa:16:3e:48:d8:9a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:27:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-changed-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Refreshing instance network info cache due to event network-changed-33dc19fe-a1fb-4820-b95a-98605ad9c595. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] Acquiring lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] Acquired lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.network.neutron [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Refreshing network info cache for port 33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.network.neutron [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updated VIF entry in instance network info cache for port 33dc19fe-a1fb-4820-b95a-98605ad9c595. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.network.neutron [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updating instance_info_cache with network_info: [{"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] Releasing lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:34 user nova-compute[74820]: WARNING nova.compute.manager [req-e4bc2888-10ac-44df-91fa-f94a1c4c3620 req-91bcaf2e-aa7c-4cc8-8856-01b0043c9f65 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 for instance with vm_state building and task_state spawning.
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:27:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] No waiting events found dispatching network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:36 user nova-compute[74820]: WARNING nova.compute.manager [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received unexpected event network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 for instance with vm_state building and task_state spawning.
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] No waiting events found dispatching network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:36 user nova-compute[74820]: WARNING nova.compute.manager [req-96ba6720-f8b0-4e03-bfe7-361769665636 req-8dbc0b64-ffd9-4452-a176-749e6a831aa7 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received unexpected event network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 for instance with vm_state building and task_state spawning.
Nov 08 18:27:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Instance spawned successfully.
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:37 user nova-compute[74820]: INFO nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Took 10.74 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:37 user nova-compute[74820]: INFO nova.compute.manager [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Took 12.04 seconds to build instance.
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-93600529-7e1c-4104-b218-4af32accc3f6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.247s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Instance spawned successfully.
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:27:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Instance spawned successfully.
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:27:38 user nova-compute[74820]: INFO nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:38 user nova-compute[74820]: INFO nova.compute.manager [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Took 8.66 seconds to build instance.
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4598426f-8ae3-436f-9e90-904c6ca9a1c9 tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.820s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:38 user nova-compute[74820]: INFO nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Took 9.63 seconds to spawn the instance on the hypervisor.
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:27:38 user nova-compute[74820]: INFO nova.compute.manager [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Took 10.80 seconds to build instance.
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b57c1ce1-a551-4406-b190-99e9fa993319 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.977s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-0dcd4f05-c70a-4951-bd7b-99effa7c27cc req-d871ee3f-04a1-4ab6-84d9-29365540b115 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0dcd4f05-c70a-4951-bd7b-99effa7c27cc req-d871ee3f-04a1-4ab6-84d9-29365540b115 service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0dcd4f05-c70a-4951-bd7b-99effa7c27cc req-d871ee3f-04a1-4ab6-84d9-29365540b115 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0dcd4f05-c70a-4951-bd7b-99effa7c27cc req-d871ee3f-04a1-4ab6-84d9-29365540b115 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-0dcd4f05-c70a-4951-bd7b-99effa7c27cc req-d871ee3f-04a1-4ab6-84d9-29365540b115 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:38 user nova-compute[74820]: WARNING nova.compute.manager [req-0dcd4f05-c70a-4951-bd7b-99effa7c27cc req-d871ee3f-04a1-4ab6-84d9-29365540b115 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state active and task_state None.
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:40 user nova-compute[74820]: WARNING nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state active and task_state None.
Nov 08 18:27:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:40 user nova-compute[74820]: WARNING nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state None.
Nov 08 18:27:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:40 user nova-compute[74820]: WARNING nova.compute.manager [req-62cd5d62-9790-4bdc-a07f-b4ab1af64bca req-045da15d-6693-4aeb-832d-d01f98d0b6ed service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state None.
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:27:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7715MB free_disk=25.636131286621094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e55b6e6b-6928-407d-b147-aa912277ec71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 133d6dc8-9328-4831-a247-d655d91d32a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:27:43 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:27:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.219s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:27:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:27:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:27:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-cc1c793f-19a6-4683-9778-c1f806d73f08 req-8bdba2be-bc5a-44cb-b61f-89ea7e935f47 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cc1c793f-19a6-4683-9778-c1f806d73f08 req-8bdba2be-bc5a-44cb-b61f-89ea7e935f47 service nova] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cc1c793f-19a6-4683-9778-c1f806d73f08 req-8bdba2be-bc5a-44cb-b61f-89ea7e935f47 service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cc1c793f-19a6-4683-9778-c1f806d73f08 req-8bdba2be-bc5a-44cb-b61f-89ea7e935f47 service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-cc1c793f-19a6-4683-9778-c1f806d73f08 req-8bdba2be-bc5a-44cb-b61f-89ea7e935f47 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] No waiting events found dispatching network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:50 user nova-compute[74820]: WARNING nova.compute.manager [req-cc1c793f-19a6-4683-9778-c1f806d73f08 req-8bdba2be-bc5a-44cb-b61f-89ea7e935f47 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received unexpected event network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c for instance with vm_state active and task_state None.
Nov 08 18:27:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] No waiting events found dispatching network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:53 user nova-compute[74820]: WARNING nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received unexpected event network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c for instance with vm_state active and task_state None.
Nov 08 18:27:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] No waiting events found dispatching network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:53 user nova-compute[74820]: WARNING nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received unexpected event network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b for instance with vm_state active and task_state None.
Nov 08 18:27:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:27:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] No waiting events found dispatching network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:27:53 user nova-compute[74820]: WARNING nova.compute.manager [req-216ce58f-4ed9-42b8-af1f-2621c5633dc0 req-725374f7-f2bb-4891-830c-cf3a157adde1 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received unexpected event network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b for instance with vm_state active and task_state None.
Nov 08 18:27:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:27:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:28:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:28:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:28:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:28:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:28:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:28:37 user nova-compute[74820]: INFO nova.compute.manager [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] instance snapshotting
Nov 08 18:28:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Beginning live snapshot process
Nov 08 18:28:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdt2i5tf7/f975b4c96adb47df821704fbf73d67f4.delta 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdt2i5tf7/f975b4c96adb47df821704fbf73d67f4.delta 1073741824" returned: 0 in 0.056s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 18:28:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74820) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 18:28:38 user nova-compute[74820]: INFO nova.virt.libvirt.host [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] UEFI support detected
Nov 08 18:28:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:28:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:28:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdt2i5tf7/f975b4c96adb47df821704fbf73d67f4.delta /opt/stack/data/nova/instances/snapshots/tmpdt2i5tf7/f975b4c96adb47df821704fbf73d67f4 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdt2i5tf7/f975b4c96adb47df821704fbf73d67f4.delta /opt/stack/data/nova/instances/snapshots/tmpdt2i5tf7/f975b4c96adb47df821704fbf73d67f4" returned: 0 in 0.505s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Snapshot extracted, beginning image upload
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Snapshot image upload complete
Nov 08 18:28:43 user nova-compute[74820]: INFO nova.compute.manager [None req-a078460a-e4c0-4de6-87cf-dfa54f860f76 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Took 5.53 seconds to snapshot the instance on the hypervisor.
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:28:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:28:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7357MB free_disk=25.504199981689453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e55b6e6b-6928-407d-b147-aa912277ec71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 133d6dc8-9328-4831-a247-d655d91d32a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:28:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:28:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:28:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:28:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:28:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-changed-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Refreshing instance network info cache due to event network-changed-5d03043b-6d05-4b75-beb0-4d59d95aeb6b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-changed-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Refreshing instance network info cache due to event network-changed-85125f2a-e0c8-4893-8e27-7036ee1bb847. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:28:46 user nova-compute[74820]: DEBUG nova.network.neutron [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Refreshing network info cache for port 85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Refreshing network info cache for port 5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updated VIF entry in instance network info cache for port 85125f2a-e0c8-4893-8e27-7036ee1bb847. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-593abc38-7678-4dfa-b2ee-9ed37e15fa94 req-931a4524-bb19-45ff-87a7-1cba11fda551 service nova] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-changed-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing instance network info cache due to event network-changed-0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:28:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG nova.network.neutron [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updated VIF entry in instance network info cache for port 5d03043b-6d05-4b75-beb0-4d59d95aeb6b. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG nova.network.neutron [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-82fb811c-ae38-44ef-aa40-940ca8af07d1 req-cbae04c9-e0af-424f-8d37-a4672cd4e265 service nova] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG nova.network.neutron [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updated VIF entry in instance network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG nova.network.neutron [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99f6a9a7-e14d-42d9-91a2-f4a3646b085b req-409e1bf6-fd95-482d-9b1c-210719120c89 service nova] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:28:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-changed-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:28:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Refreshing instance network info cache due to event network-changed-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:28:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] Acquiring lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:28:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] Acquired lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:28:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Refreshing network info cache for port 4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:28:50 user nova-compute[74820]: DEBUG nova.network.neutron [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updated VIF entry in instance network info cache for port 4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:28:50 user nova-compute[74820]: DEBUG nova.network.neutron [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updating instance_info_cache with network_info: [{"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:28:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a4eefca3-1e6f-449d-bb23-6d1f515cb0fe req-4e6e2350-7fae-431f-bdea-cf2bd1880080 service nova] Releasing lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:28:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:56 user nova-compute[74820]: INFO nova.compute.manager [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Shelving
Nov 08 18:28:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG nova.compute.manager [req-f6e1a54f-d774-41d7-9e74-29f2bfd46eda req-2b0edc9a-376d-44bf-b7a7-50cd2d8f52f1 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-unplugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f6e1a54f-d774-41d7-9e74-29f2bfd46eda req-2b0edc9a-376d-44bf-b7a7-50cd2d8f52f1 service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f6e1a54f-d774-41d7-9e74-29f2bfd46eda req-2b0edc9a-376d-44bf-b7a7-50cd2d8f52f1 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f6e1a54f-d774-41d7-9e74-29f2bfd46eda req-2b0edc9a-376d-44bf-b7a7-50cd2d8f52f1 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:28:56 user nova-compute[74820]: DEBUG nova.compute.manager [req-f6e1a54f-d774-41d7-9e74-29f2bfd46eda req-2b0edc9a-376d-44bf-b7a7-50cd2d8f52f1 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-unplugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:28:56 user nova-compute[74820]: WARNING nova.compute.manager [req-f6e1a54f-d774-41d7-9e74-29f2bfd46eda req-2b0edc9a-376d-44bf-b7a7-50cd2d8f52f1 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-unplugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state active and task_state shelving.
Nov 08 18:28:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance destroyed successfully.
Nov 08 18:28:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Beginning cold snapshot process
Nov 08 18:28:57 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:28:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk /opt/stack/data/nova/instances/snapshots/tmpk1uym9sd/f9d9b096ca33425aa16836d67e06b795 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:28:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk /opt/stack/data/nova/instances/snapshots/tmpk1uym9sd/f9d9b096ca33425aa16836d67e06b795" returned: 0 in 0.860s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:28:57 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Snapshot extracted, beginning image upload
Nov 08 18:28:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:28:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-b36a6655-87a5-4e16-9121-b8856e2b8d6c req-375d8500-27b8-4e6e-b528-4114eb5143a7 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:28:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b36a6655-87a5-4e16-9121-b8856e2b8d6c req-375d8500-27b8-4e6e-b528-4114eb5143a7 service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b36a6655-87a5-4e16-9121-b8856e2b8d6c req-375d8500-27b8-4e6e-b528-4114eb5143a7 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b36a6655-87a5-4e16-9121-b8856e2b8d6c req-375d8500-27b8-4e6e-b528-4114eb5143a7 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:28:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-b36a6655-87a5-4e16-9121-b8856e2b8d6c req-375d8500-27b8-4e6e-b528-4114eb5143a7 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:28:58 user nova-compute[74820]: WARNING nova.compute.manager [req-b36a6655-87a5-4e16-9121-b8856e2b8d6c req-375d8500-27b8-4e6e-b528-4114eb5143a7 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 18:28:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:59 user nova-compute[74820]: DEBUG nova.objects.instance [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:28:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:28:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:28:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:28:59 user nova-compute[74820]: INFO nova.compute.manager [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Attaching volume 68c00436-74b0-4297-ba4f-5fbbbb70f5ca to /dev/vdb
Nov 08 18:29:00 user nova-compute[74820]: DEBUG os_brick.utils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:00 user nova-compute[74820]: INFO oslo.privsep.daemon [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7hkdday9/privsep.sock']
Nov 08 18:29:00 user sudo[86589]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7hkdday9/privsep.sock
Nov 08 18:29:00 user sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 18:29:01 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Snapshot image upload complete
Nov 08 18:29:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:29:01 user nova-compute[74820]: INFO nova.compute.manager [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Shelve offloading
Nov 08 18:29:01 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance destroyed successfully.
Nov 08 18:29:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:29:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:29:01 user sudo[86589]: pam_unix(sudo:session): session closed for user root
Nov 08 18:29:01 user nova-compute[74820]: INFO oslo.privsep.daemon [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Spawned new privsep daemon via rootwrap
Nov 08 18:29:01 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 18:29:01 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 18:29:01 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 18:29:01 user nova-compute[74820]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86592
Nov 08 18:29:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d52eb-5a99-45b7-9463-a905b2bf446d]: (2,) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abd187-d20d-4a7c-ba69-ef71f0a40d6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:02 user nova-compute[74820]: WARNING os_brick.initiator.connectors.nvmeof [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be41961b-a139-4dee-a028-b52d318d15e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[386c6a7f-f9d4-4e63-81a1-2577a486d575]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5962bb7f-b85e-4e63-a61c-5b98d865c5bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:02 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5892b18-05d0-45e7-87af-a886c3c25c13]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG os_brick.utils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== get_connector_properties: return (2091ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updating existing volume attachment record: c7941c2f-757b-4056-9628-49e1320c48ca {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance destroyed successfully.
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'resources' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2024314283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2024314283',id=3,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg5ezgL7fDWQ0j/n0PZICZmy/N40SmvarZlg0lwj9ZxwPwrOi0ct8zDukLJqKXjIKyOJTAldRJwsA3bHrOhRGpdv9w2rDG4gi4E5jjouezEz1BjOl1yccMqb2+N4CIaEQ==',key_name='tempest-keypair-1409935399',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-kk2xmpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member',shelved_at='2023-11-08T18:29:01.425741',shelved_host='user',shelved_image_id='a45257d5-6f91-4054-a63f-5a094eb28582'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=1f6a8436-ae6e-4edb-8046-baccf72c6560,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG os_vif [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-changed-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing instance network info cache due to event network-changed-0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a750543-2d, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0106f4e9-3bf8-4448-956d-a2a6f1d75faa) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:29:02 user nova-compute[74820]: INFO os_vif [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d')
Nov 08 18:29:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Deleting instance files /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560_del
Nov 08 18:29:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Deletion of /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560_del complete
Nov 08 18:29:02 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Deleted allocations for instance 1f6a8436-ae6e-4edb-8046-baccf72c6560
Nov 08 18:29:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG nova.objects.base [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<1f6a8436-ae6e-4edb-8046-baccf72c6560> lazy-loaded attributes: resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG nova.network.neutron [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updated VIF entry in instance network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG nova.network.neutron [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0a750543-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9975c148-b885-4cc5-9297-9b05a367fd8e req-ae7fe02c-c69d-4012-9daf-45ae93d3263b service nova] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f3d66610-ce41-4c4d-b128-83412564cf8b tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.185s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-changed-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Refreshing instance network info cache due to event network-changed-b9cf1ca9-4e85-46fd-93b1-f5a68165949c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] Acquiring lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] Acquired lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG nova.network.neutron [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Refreshing network info cache for port b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG nova.network.neutron [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updated VIF entry in instance network info cache for port b9cf1ca9-4e85-46fd-93b1-f5a68165949c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG nova.network.neutron [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updating instance_info_cache with network_info: [{"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a3902e5f-f984-4eaf-b89f-989683d1b926 req-1fa5ba7b-eecd-4b96-b41c-058052b1a603 service nova] Releasing lock "refresh_cache-818ce0ba-7664-4625-9cc9-45a46d4a2e02" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Acquiring lock "8916abda-c9a1-4dd6-b70d-f94f430a09e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Lock "8916abda-c9a1-4dd6-b70d-f94f430a09e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:29:10 user nova-compute[74820]: INFO nova.compute.claims [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Claim successful on node user
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:29:10 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:29:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:29:10 user nova-compute[74820]: INFO nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Booting with volume 8f5c45d8-d1a7-44c4-a169-358e252ce9c2 at /dev/vda
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG nova.policy [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ba533d7f9174c5fa897d608ca9461d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b915018e814881844297432ef6d86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b0128f-bcd4-4a06-8997-ab771227e095]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e8bedc-347d-43dc-9895-9bc81f50e9b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30e3fb-5526-413e-b97f-2cae29f1883e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9b5a9d-599a-4f42-9f38-09c216aeb4e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:11 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ce7db2-8bdc-41d1-a645-eada1a0a8377]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating existing volume attachment record: 2349063e-107e-4dad-b68d-b142802519a5 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG nova.objects.instance [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lazy-loading 'flavor' on Instance uuid 818ce0ba-7664-4625-9cc9-45a46d4a2e02 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully created port: 24054ffb-55bd-4c9c-933f-ac134b12d223 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:11 user nova-compute[74820]: INFO nova.compute.manager [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Attaching volume 210f9b90-e1b6-4560-8157-aa70c46d335c to /dev/sdc
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.utils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba267ba-558d-42bc-958d-4186818337a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab177e-2b5f-412f-858f-ad4bab94afdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca71ecb-f100-400b-80ef-32d22353e461]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fa39f-152f-497b-ad0b-17a739dd6684]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:12 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd8443e-328c-483e-8af3-eb6148e2d421]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG os_brick.utils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updating existing volume attachment record: 823a6237-f9d1-4d53-b617-8f66c50ca096 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully created port: 02a77b9b-5642-4f25-b323-d28ae21ef125 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully created port: 3a7a7a14-9c7e-4601-87e3-5459f866ab4b {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully created port: 5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully created port: 78ff28e2-3cf0-4c61-a91b-13c054ac8899 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 24054ffb-55bd-4c9c-933f-ac134b12d223 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-24054ffb-55bd-4c9c-933f-ac134b12d223 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-24054ffb-55bd-4c9c-933f-ac134b12d223. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 24054ffb-55bd-4c9c-933f-ac134b12d223 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cd56325e-4992-4d9a-801e-5af6e09ea33f req-e48f2eff-ddfb-44ce-8d45-f2007175bf23 service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 907f9a9f-55b2-413b-8207-2d3786c7cfc8 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-changed-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Refreshing instance network info cache due to event network-changed-7c540edf-72b4-4381-a2fb-48cc243f9449. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Refreshing network info cache for port 7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 9f9113d5-a97e-46b0-86b5-2ef805dd58eb {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updated VIF entry in instance network info cache for port 7c540edf-72b4-4381-a2fb-48cc243f9449. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "interface-a2eddce3-e832-4737-be16-6d6a6ba7dc77-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "interface-a2eddce3-e832-4737-be16-6d6a6ba7dc77-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'flavor' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-787c8b36-8aa6-4e34-853d-f126a7298ca7 req-678e7f76-e5f0-4777-a5af-3d202bb2e9cf service nova] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'pci_requests' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.objects.base [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Object Instance<a2eddce3-e832-4737-be16-6d6a6ba7dc77> lazy-loaded attributes: flavor,pci_requests {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.policy [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bba75245b8d34d669ab6a0faa6c40330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e1f2856b5a49b9b23dedc7f4e0ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-907f9a9f-55b2-413b-8207-2d3786c7cfc8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-907f9a9f-55b2-413b-8207-2d3786c7cfc8. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 907f9a9f-55b2-413b-8207-2d3786c7cfc8 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-9f9113d5-a97e-46b0-86b5-2ef805dd58eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-9f9113d5-a97e-46b0-86b5-2ef805dd58eb. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 9f9113d5-a97e-46b0-86b5-2ef805dd58eb {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Successfully created port: 0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-25a36507-7f56-401a-be86-11daa39c5de9 req-61118796-2ec3-4590-b8af-5ea7925d8676 service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 02a77b9b-5642-4f25-b323-d28ae21ef125 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Successfully updated port: 0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-changed-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Refreshing instance network info cache due to event network-changed-0b9dc916-5c77-4494-8657-79f2b7b6ab69. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 3a7a7a14-9c7e-4601-87e3-5459f866ab4b {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-changed-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Refreshing instance network info cache due to event network-changed-6be3d780-e87b-4b09-8e2c-7faca121591b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] Acquiring lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] Acquired lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:18 user nova-compute[74820]: DEBUG nova.network.neutron [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Refreshing network info cache for port 6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Refreshing network info cache for port 0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG os_vif [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7872a01-0de2-52df-9191-05a318e71097', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b9dc916-5c, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b9dc916-5c, col_values=(('qos', UUID('e91d5b16-ed26-40ec-9656-18c1e892e505')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b9dc916-5c, col_values=(('external_ids', {'iface-id': '0b9dc916-5c77-4494-8657-79f2b7b6ab69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:ab:10', 'vm-uuid': 'a2eddce3-e832-4737-be16-6d6a6ba7dc77'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: INFO os_vif [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c')
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] attach device xml: <interface type="ethernet">
Nov 08 18:29:19 user nova-compute[74820]:   <mac address="fa:16:3e:6c:ab:10"/>
Nov 08 18:29:19 user nova-compute[74820]:   <model type="virtio"/>
Nov 08 18:29:19 user nova-compute[74820]:   <mtu size="1442"/>
Nov 08 18:29:19 user nova-compute[74820]:   <target dev="tap0b9dc916-5c"/>
Nov 08 18:29:19 user nova-compute[74820]: </interface>
Nov 08 18:29:19 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-02a77b9b-5642-4f25-b323-d28ae21ef125 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-02a77b9b-5642-4f25-b323-d28ae21ef125. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 02a77b9b-5642-4f25-b323-d28ae21ef125 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updated VIF entry in instance network info cache for port 6be3d780-e87b-4b09-8e2c-7faca121591b. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating instance_info_cache with network_info: [{"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c824bd08-8cf4-407c-917a-85ed918adbf2 req-877064b7-2f5a-47c8-a55f-dc9610c9138e service nova] Releasing lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No BDM found with device name hda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No VIF found with MAC fa:16:3e:f5:43:e0, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:29:19 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:29:19 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:29:19 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:29:19</nova:creationTime>
Nov 08 18:29:19 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:29:19 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:29:19 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:29:19 user nova-compute[74820]:   <nova:owner>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:29:19 user nova-compute[74820]:   </nova:owner>
Nov 08 18:29:19 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:29:19 user nova-compute[74820]:   <nova:ports>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:29:19 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:29:19 user nova-compute[74820]:     </nova:port>
Nov 08 18:29:19 user nova-compute[74820]:     <nova:port uuid="0b9dc916-5c77-4494-8657-79f2b7b6ab69">
Nov 08 18:29:19 user nova-compute[74820]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Nov 08 18:29:19 user nova-compute[74820]:     </nova:port>
Nov 08 18:29:19 user nova-compute[74820]:   </nova:ports>
Nov 08 18:29:19 user nova-compute[74820]: </nova:instance>
Nov 08 18:29:19 user nova-compute[74820]:  {{(pid=74820) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 18:29:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-25b5a246-9af5-46f7-be58-1d44f8e39057 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "interface-a2eddce3-e832-4737-be16-6d6a6ba7dc77-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.539s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-3a7a7a14-9c7e-4601-87e3-5459f866ab4b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-3a7a7a14-9c7e-4601-87e3-5459f866ab4b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 3a7a7a14-9c7e-4601-87e3-5459f866ab4b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updated VIF entry in instance network info cache for port 0b9dc916-5c77-4494-8657-79f2b7b6ab69. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d1ac8770-9f8d-46d6-8fe9-437bc83bbb1f req-052898ae-0fda-4ee8-9189-2aae23f78614 service nova] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Successfully updated port: 78ff28e2-3cf0-4c61-a91b-13c054ac8899 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-changed-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Refreshing instance network info cache due to event network-changed-33dc19fe-a1fb-4820-b95a-98605ad9c595. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] Acquiring lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] Acquired lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Refreshing network info cache for port 33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a346a9fa-d36d-442b-809f-9f6e2e56a9fa req-bedf28df-11da-4887-9db5-9ff10d7dc30a service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updated VIF entry in instance network info cache for port 33dc19fe-a1fb-4820-b95a-98605ad9c595. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updating instance_info_cache with network_info: [{"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-50969bff-5821-4974-bc33-2a382839c2bc req-d554e538-eb14-4bb1-8af9-fc179e19b472 service nova] Releasing lock "refresh_cache-c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [{"id": "24054ffb-55bd-4c9c-933f-ac134b12d223", "address": "fa:16:3e:b1:7d:90", "network": {"id": "78380ca1-7219-4330-9d40-a8b4c6a1f72f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2053709143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24054ffb-55", "ovs_interfaceid": "24054ffb-55bd-4c9c-933f-ac134b12d223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "address": "fa:16:3e:1a:db:e5", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f9a9f-55", "ovs_interfaceid": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "address": "fa:16:3e:80:3c:a3", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9113d5-a9", "ovs_interfaceid": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "02a77b9b-5642-4f25-b323-d28ae21ef125", "address": "fa:16:3e:c7:09:44", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a77b9b-56", "ovs_interfaceid": "02a77b9b-5642-4f25-b323-d28ae21ef125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "address": "fa:16:3e:cd:f4:25", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7a7a14-9c", "ovs_interfaceid": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "address": "fa:16:3e:17:75:50", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ce0b8-0b", "ovs_interfaceid": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "address": "fa:16:3e:52:e6:83", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ff28e2-3c", "ovs_interfaceid": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance network_info: |[{"id": "24054ffb-55bd-4c9c-933f-ac134b12d223", "address": "fa:16:3e:b1:7d:90", "network": {"id": "78380ca1-7219-4330-9d40-a8b4c6a1f72f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2053709143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24054ffb-55", "ovs_interfaceid": "24054ffb-55bd-4c9c-933f-ac134b12d223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "address": "fa:16:3e:1a:db:e5", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f9a9f-55", "ovs_interfaceid": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "address": "fa:16:3e:80:3c:a3", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9113d5-a9", "ovs_interfaceid": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "02a77b9b-5642-4f25-b323-d28ae21ef125", "address": "fa:16:3e:c7:09:44", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a77b9b-56", "ovs_interfaceid": "02a77b9b-5642-4f25-b323-d28ae21ef125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "address": "fa:16:3e:cd:f4:25", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7a7a14-9c", "ovs_interfaceid": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "address": "fa:16:3e:17:75:50", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ce0b8-0b", "ovs_interfaceid": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "address": "fa:16:3e:52:e6:83", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ff28e2-3c", "ovs_interfaceid": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:29:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connector [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Factory for ISCSI on None {{(pid=74820) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyMenrdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:34 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:29:34 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:29:34 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96ac74f-f456-4a86-ad9d-817779e49eed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:29:34 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9eb1cd-ba45-49bf-88a5-9290f31f73f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca] added
Nov 08 18:29:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[444faf63-2726-4d86-94b3-3fbf828beb4e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb0ecd-524d-4ddd-b8aa-85cab1108475]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UyMenrdw {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UyMenrdw" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d1bdc-66d5-4ea1-aeea-aa32346779a3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UyMenrdw'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[68216d71-c6b1-4633-af83-a93b43b065e1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[980813d5-e720-46e8-81ba-a241034f1656]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 18:29:34 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 18:29:34 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:29:34 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 18:29:34 user nova-compute[74820]: 
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a8e4c7-6e2a-4241-be42-2225a7414f44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260]
Nov 08 18:29:34 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260] successful.
Nov 08 18:29:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb141d7-67d9-41a7-9142-aa1ddd9735f3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[845403d3-9628-46be-bf6b-a7cb779da864]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:29:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:29:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa674319-e87e-4506-bb16-a378d3159d10]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:34 user nova-compute[74820]: DEBUG nova.objects.instance [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lazy-loading 'flavor' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'flavor' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lazy-loading 'flavor' on Instance uuid c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: INFO nova.compute.manager [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Attaching volume c97896dc-62f2-489c-9a8a-7b83093bd1dc to /dev/vdb
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 for instance with vm_state active and task_state None.
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 for instance with vm_state active and task_state None.
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Received event network-changed-78ff28e2-3cf0-4c61-a91b-13c054ac8899 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing instance network info cache due to event network-changed-78ff28e2-3cf0-4c61-a91b-13c054ac8899. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Acquiring lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Acquired lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Refreshing network info cache for port 78ff28e2-3cf0-4c61-a91b-13c054ac8899 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:35 user nova-compute[74820]: INFO nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Booting with volume f871047b-86c5-4899-86ba-56563ce2c5f3 at /dev/vdb
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: INFO nova.compute.manager [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Attaching volume 38f36f35-b638-48ca-b9b1-ad31b45d5d79 to /dev/vdb
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:35 user nova-compute[74820]: INFO nova.compute.manager [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Attaching volume 3ed1c86f-0e07-4d30-a45c-4acb4864949f to /dev/vdb
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.utils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[214407b3-ca7b-459d-b0f9-2f0453188cda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTgdLVKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30019ded-6555-4d1b-9b71-101b3c8df067]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.utils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662b3c5-04ea-4e5d-9e00-74eba7514abd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f12909-d211-46fb-b957-071b0f3e7ac8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd2b860-936e-4e8b-a8ee-cb2347d57f27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d355362-dd98-47a9-a1f8-26ce80abce1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e0ca7-5d70-4f4c-804e-82e5188713da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.utils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c33c5-9962-4690-886b-841c17ab7e5e]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.utils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating existing volume attachment record: 1e15ce47-c95a-4aeb-8ee0-028c0fc3ab96 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be419d-8218-4dd8-b486-c9e6b52dcb72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb1bcf-f31d-490e-91c7-e17550f28e49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a814df13-eceb-4aab-b5c4-dfe91e99d60a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9dca9c-f315-4b7f-b5a3-8b87c5efd258]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e9ff3-440a-4b19-a448-e0555e805bf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5c29c5-4079-4544-9464-2d9a0c839ed3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5c4674-c15e-49d3-a560-5528663bae33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81565275-bb3e-422c-90f2-85bd31e97007]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] <== get_connector_properties: return (250ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating existing volume attachment record: 7c3a1400-b182-4ecb-bfae-2369084ed8a2 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f359da68-22b8-45a7-8adf-9e0df897474b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9857aa-a992-4189-ad0d-07e6c6490a9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyMenrdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23230666462393064', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230666462393064', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.313s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:29:35 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:35 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[775cd1b3-b1ab-40e1-8cc0-15a3da2f348d]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f232d4-b620-4407-98fe-bb41e1fa72ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:29:36 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.network.neutron [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updated VIF entry in instance network info cache for port 78ff28e2-3cf0-4c61-a91b-13c054ac8899. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.network.neutron [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [{"id": "24054ffb-55bd-4c9c-933f-ac134b12d223", "address": "fa:16:3e:b1:7d:90", "network": {"id": "78380ca1-7219-4330-9d40-a8b4c6a1f72f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2053709143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24054ffb-55", "ovs_interfaceid": "24054ffb-55bd-4c9c-933f-ac134b12d223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "address": "fa:16:3e:1a:db:e5", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f9a9f-55", "ovs_interfaceid": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "address": "fa:16:3e:80:3c:a3", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9113d5-a9", "ovs_interfaceid": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "02a77b9b-5642-4f25-b323-d28ae21ef125", "address": "fa:16:3e:c7:09:44", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a77b9b-56", "ovs_interfaceid": "02a77b9b-5642-4f25-b323-d28ae21ef125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "address": "fa:16:3e:cd:f4:25", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7a7a14-9c", "ovs_interfaceid": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "address": "fa:16:3e:17:75:50", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ce0b8-0b", "ovs_interfaceid": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "address": "fa:16:3e:52:e6:83", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ff28e2-3c", "ovs_interfaceid": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:29:36 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1246fa8-191f-41f5-b2e1-112ce697d1af]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.utils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] <== get_connector_properties: return (357ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updating existing volume attachment record: 3cc80f46-49da-449d-bdb2-0db545eabd7b {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.utils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] <== get_connector_properties: return (304ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating existing volume attachment record: ee4594c5-291c-443e-a0b2-ff6d65cbfa4a {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[674cd754-a1a5-490f-9775-dff36694d067]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c] added
Nov 08 18:29:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8289ec6c-dc30-4338-9366-d665714882e4 req-e0d48d20-5d83-4e00-814f-65f5fd8c64ee service nova] Releasing lock "refresh_cache-8916abda-c9a1-4dd6-b70d-f94f430a09e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.objects.instance [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e211b72-f92e-4450-b0cd-de2224037344]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:29:36 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:29:36 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:29:36 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:29:36 user nova-compute[74820]:   <serial>68c00436-74b0-4297-ba4f-5fbbbb70f5ca</serial>
Nov 08 18:29:36 user nova-compute[74820]: </disk>
Nov 08 18:29:36 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1986c-99e0-4a28-bf32-aeebf2e938ee]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTgdLVKR {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yTgdLVKR" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[099cfd5e-2a2a-4d79-a3e6-ff399fa72245]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yTgdLVKR'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace61bdd-d717-4296-8f83-8ac1b7fa6cdd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec18f8c-51e1-4386-8cbf-dd0fc5ecec84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:29:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:29:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aa0d0f-72b8-42a9-9cf3-e4e4976406f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260]
Nov 08 18:29:36 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260] successful.
Nov 08 18:29:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be540ab6-8b08-4bbf-bc5a-c43cc7ee7264]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df52718-cea9-4d7b-ad6d-b2e42f58e4dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:29:36 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:29:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:29:36 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:29:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a638ce-17bf-4ccd-8242-8c5a73726e5e]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTgdLVKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No VIF found with MAC fa:16:3e:28:1d:78, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] <== connect_volume: return (1745ms) {'type': 'block', 'scsi_wwn': '23266306133613334', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266306133613334', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG nova.objects.instance [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lazy-loading 'flavor' on Instance uuid 818ce0ba-7664-4625-9cc9-45a46d4a2e02 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:29:37 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:29:37 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:29:37 user nova-compute[74820]:   <target dev="sdc" bus="scsi"/>
Nov 08 18:29:37 user nova-compute[74820]:   <serial>210f9b90-e1b6-4560-8157-aa70c46d335c</serial>
Nov 08 18:29:37 user nova-compute[74820]:   <address type="drive" controller="0" unit="2"/>
Nov 08 18:29:37 user nova-compute[74820]: </disk>
Nov 08 18:29:37 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No BDM found with device name sda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:29:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] No VIF found with MAC fa:16:3e:e3:c9:38, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:29:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:40 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (sdc) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:29:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:29:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:29:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7792MB free_disk=25.456920623779297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e55b6e6b-6928-407d-b147-aa912277ec71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 133d6dc8-9328-4831-a247-d655d91d32a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:29:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "c51df6e9-c969-4869-88be-77c877029dde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:29:45 user nova-compute[74820]: INFO nova.compute.claims [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Claim successful on node user
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:29:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.policy [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5790613f8a24f52897aedd0634f7f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77a76c049904c6abe35b10929563c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:29:45 user nova-compute[74820]: INFO nova.virt.block_device [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Booting with blank volume at /dev/vda
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:29:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 08 18:29:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Successfully created port: b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:29:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:29:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updating instance_info_cache with network_info: [{"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-e55b6e6b-6928-407d-b147-aa912277ec71" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Successfully updated port: b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-changed-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Refreshing instance network info cache due to event network-changed-b5562326-c480-40aa-80ab-db849577b104. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] Acquiring lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance network_info: |[{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] Acquired lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Refreshing network info cache for port b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updated VIF entry in instance network info cache for port b5562326-c480-40aa-80ab-db849577b104. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:29:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-353ad574-d7a5-4a4a-ba40-9c3ec01e82dd req-40e2bb1b-0158-4934-b9a8-ae74f90e973f service nova] Releasing lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:29:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:29:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:00 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAUxpWte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c373c573-c0ca-486e-b2e1-b7098eeb4b01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:30:00 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a440ff4-fdae-4fde-8df6-f0e357b3cee1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc] added
Nov 08 18:30:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ec2174-0c41-40b9-9769-3eb0c523b2a6]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6767e83-7599-4c3a-a88a-cf932b5bf2a3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYmJSpbG {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYmJSpbG" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac6ff4-e0f5-4fb9-b8d8-77a6785689c1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYmJSpbG'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74716de6-afbe-4245-bd9a-71dcd4314f01 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.799s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc164930-cf02-40a8-bf2a-e40c408eac90]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2130a262-2210-4a43-bc51-5096cd3f010d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:00 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:00 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d869a4-7424-47b1-a4d1-cb0166e79008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]
Nov 08 18:30:00 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.
Nov 08 18:30:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[27af3cd2-49ca-44f3-aa18-9a471fd4526a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-77b28cae-67e3-4032-b73a-22d7964e4eb4 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.164s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9bd512-efc0-4e23-ad98-f2b5355b9b2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:00 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:00 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:00 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:00 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b046294-71c0-4c0c-8d6b-20bc2f51057b]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:30:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:30:01 user nova-compute[74820]: INFO nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Booting with volume de002da2-5fa4-443f-b1ac-d057e349cfbd at /dev/vdc
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6243b952-3156-4852-ab08-25f50f310cd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a895dc-e72f-451d-b77e-62cc3a2f1768]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad76f3-1c5a-4dad-a36f-bcfe4b44102b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a73c3-0c41-45d1-a7cc-b85225a432bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:01 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4663e413-d428-485e-905a-159686c7da06]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating existing volume attachment record: d9f02c91-bece-4ca1-8398-8396c1b48f5b {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23838633165383137', 'path': '/dev/sdd'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838633165383137', 'path': '/dev/sdd'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.301s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:01 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:01 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG nova.objects.instance [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lazy-loading 'flavor' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ccb8d-3ac4-4890-a46c-93ff98fa69cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:30:02 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[617518d4-a89b-42e6-9ff4-1c2787104dae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79] added
Nov 08 18:30:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:30:02 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:02 user nova-compute[74820]:   <source dev="/dev/sdd"/>
Nov 08 18:30:02 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:02 user nova-compute[74820]:   <serial>c97896dc-62f2-489c-9a8a-7b83093bd1dc</serial>
Nov 08 18:30:02 user nova-compute[74820]: </disk>
Nov 08 18:30:02 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d94d18-7bfe-4eca-a952-55c7e41a0ae2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9b5d6d-4716-470c-bde8-bca65128fc1b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cAUxpWte {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cAUxpWte" returned: 0 in 0.103s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[22774d32-626b-4d35-b694-1d6fdde7ed38]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cAUxpWte'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc77ed19-0b5f-4cbb-8534-e165e06119c9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cbe665-a625-42fe-b5c7-5a79a5620d5a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[036edb92-fc40-45e1-a9a7-2ebfdd4f43ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260]
Nov 08 18:30:02 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260] successful.
Nov 08 18:30:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab47e4-6934-499c-a580-3151557401e4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe2596-1442-420e-b7f7-5c6a4c39b1af]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:02 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c8dcd-058e-4515-856f-8470f7110b74]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAUxpWte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] No VIF found with MAC fa:16:3e:ab:ac:9f, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cc9dd691-0889-4843-9abc-223e9f8ca2ba tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.339s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Acquiring lock "b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Lock "b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:02 user nova-compute[74820]: INFO nova.compute.manager [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Detaching volume 210f9b90-e1b6-4560-8157-aa70c46d335c
Nov 08 18:30:02 user nova-compute[74820]: INFO nova.virt.block_device [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Attempting to driver detach volume 210f9b90-e1b6-4560-8157-aa70c46d335c from mountpoint /dev/sdc
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:30:02 user nova-compute[74820]: INFO nova.compute.claims [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Claim successful on node user
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Attempting to detach device sdc from instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:30:02 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:02 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:30:02 user nova-compute[74820]:   <target dev="sdc" bus="scsi"/>
Nov 08 18:30:02 user nova-compute[74820]:   <serial>210f9b90-e1b6-4560-8157-aa70c46d335c</serial>
Nov 08 18:30:02 user nova-compute[74820]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 18:30:02 user nova-compute[74820]: </disk>
Nov 08 18:30:02 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:30:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Successfully detached device sdc from instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 from the persistent domain config.
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:30:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:30:02 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:02 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:30:02 user nova-compute[74820]:   <target dev="sdc" bus="scsi"/>
Nov 08 18:30:02 user nova-compute[74820]:   <serial>210f9b90-e1b6-4560-8157-aa70c46d335c</serial>
Nov 08 18:30:02 user nova-compute[74820]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 18:30:02 user nova-compute[74820]: </disk>
Nov 08 18:30:02 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:30:03 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] <== connect_volume: return (2785ms) {'type': 'block', 'scsi_wwn': '26261333638636565', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261333638636565', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lazy-loading 'flavor' on Instance uuid c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 18:30:03 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:03 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:30:03 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:03 user nova-compute[74820]:   <serial>38f36f35-b638-48ca-b9b1-ad31b45d5d79</serial>
Nov 08 18:30:03 user nova-compute[74820]: </disk>
Nov 08 18:30:03 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.utils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: INFO nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Booting with volume ecc4f77a-f0cd-4316-95a8-8e7590983a3c at /dev/vda
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d481a2-ac07-41bd-a35e-a75b9cad6f19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df62442-366f-41d0-996a-b45b7b2f5403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.policy [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8fdbf41ef1d4a01b8121754e0618870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149a7cfea1764821ae439bd5207ecca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19004494-90d5-4161-bdd6-fcefcdac16f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24dddc4-4f69-401e-8866-0e87bb366c3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.utils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a846b84c-4553-4a71-9a71-790f6ebe89f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:03 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61150377-6be3-4f25-a343-8f725ea6c5dd]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.utils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad156b4b-c069-4462-9849-f9ddc1ae6df9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a3243-e80b-44e5-b999-cee9fdbe5bfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72fad24-a4e7-437b-89ca-f4459fa57e8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:03 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:30:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a560d98c-da6b-4ab8-9102-ec43080718b1]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG os_brick.utils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating existing volume attachment record: ccf95ebe-37ac-4d7b-b87c-cc387caa03ad {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:30:03 user nova-compute[74820]: INFO nova.compute.manager [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Swapping volume c97896dc-62f2-489c-9a8a-7b83093bd1dc for f3577301-887e-4294-a6fa-000e62e95c85
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] No VIF found with MAC fa:16:3e:48:d8:9a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully created port: e6dbeff1-7811-4223-a3b0-a69036de1732 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "03b7e5da-f78f-423f-9e8d-77588b710547" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:30:04 user nova-compute[74820]: INFO nova.compute.claims [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Claim successful on node user
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully created port: 2bbaabd7-077f-4b83-9e65-a127b740ff98 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:30:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.policy [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecfee2b968614f47aa97aafd07b66548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f45aa33327417986332546abed6d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:30:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Creating image(s)
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "/opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk 1073741824" returned: 0 in 0.063s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully created port: 8a9f1bf6-f57b-4c14-9120-6e6448516d4d {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Successfully created port: 99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Cannot resize image /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Ensure instance console log exists: /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully created port: 472e91c7-b54d-45df-87ca-4afbda52653a {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Successfully updated port: 99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquired lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-changed-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Refreshing instance network info cache due to event network-changed-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] Acquiring lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully created port: 1a63188e-a8b1-436a-a767-25ba732d9a6f {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Updating instance_info_cache with network_info: [{"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Releasing lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Instance network_info: |[{"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] Acquired lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Refreshing network info cache for port 99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Start _get_guest_xml network_info=[{"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:30:07 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:30:07 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-929490939',display_name='tempest-AttachVolumeNegativeTest-server-929490939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-929490939',id=13,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcmuSkw2lVgZLTqICtcZJHJKfuZCHmE3MHdsPUZvUz1+czR3blcZWG3BB/sPistMwWSqzbeo5GbsE8J7jPSxexLH7zHo9hDYoTDfzmAUXRvKBkAUD9n1t0ZN86i3yhDqA==',key_name='tempest-keypair-1178429342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-d0f240kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=03b7e5da-f78f-423f-9e8d-77588b710547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'pci_devices' on Instance uuid 03b7e5da-f78f-423f-9e8d-77588b710547 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:30:07 user nova-compute[74820]:   <uuid>03b7e5da-f78f-423f-9e8d-77588b710547</uuid>
Nov 08 18:30:07 user nova-compute[74820]:   <name>instance-0000000d</name>
Nov 08 18:30:07 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:30:07 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:30:07 user nova-compute[74820]:   <metadata>
Nov 08 18:30:07 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:30:07 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:30:07 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-929490939</nova:name>
Nov 08 18:30:07 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:30:07</nova:creationTime>
Nov 08 18:30:07 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:30:07 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:30:07 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:30:07 user nova-compute[74820]:       <nova:owner>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:user uuid="ecfee2b968614f47aa97aafd07b66548">tempest-AttachVolumeNegativeTest-657533753-project-member</nova:user>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:project uuid="d4f45aa33327417986332546abed6d92">tempest-AttachVolumeNegativeTest-657533753</nova:project>
Nov 08 18:30:07 user nova-compute[74820]:       </nova:owner>
Nov 08 18:30:07 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:30:07 user nova-compute[74820]:       <nova:ports>
Nov 08 18:30:07 user nova-compute[74820]:         <nova:port uuid="99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c">
Nov 08 18:30:07 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 18:30:07 user nova-compute[74820]:         </nova:port>
Nov 08 18:30:07 user nova-compute[74820]:       </nova:ports>
Nov 08 18:30:07 user nova-compute[74820]:     </nova:instance>
Nov 08 18:30:07 user nova-compute[74820]:   </metadata>
Nov 08 18:30:07 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:30:07 user nova-compute[74820]:     <system>
Nov 08 18:30:07 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:30:07 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:30:07 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:30:07 user nova-compute[74820]:       <entry name="serial">03b7e5da-f78f-423f-9e8d-77588b710547</entry>
Nov 08 18:30:07 user nova-compute[74820]:       <entry name="uuid">03b7e5da-f78f-423f-9e8d-77588b710547</entry>
Nov 08 18:30:07 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:30:07 user nova-compute[74820]:     </system>
Nov 08 18:30:07 user nova-compute[74820]:   </sysinfo>
Nov 08 18:30:07 user nova-compute[74820]:   <os>
Nov 08 18:30:07 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:30:07 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:30:07 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:30:07 user nova-compute[74820]:   </os>
Nov 08 18:30:07 user nova-compute[74820]:   <features>
Nov 08 18:30:07 user nova-compute[74820]:     <acpi/>
Nov 08 18:30:07 user nova-compute[74820]:     <apic/>
Nov 08 18:30:07 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:30:07 user nova-compute[74820]:   </features>
Nov 08 18:30:07 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:30:07 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:30:07 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:30:07 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:30:07 user nova-compute[74820]:   </clock>
Nov 08 18:30:07 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:30:07 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:30:07 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:30:07 user nova-compute[74820]:   </cpu>
Nov 08 18:30:07 user nova-compute[74820]:   <devices>
Nov 08 18:30:07 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:30:07 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:30:07 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk"/>
Nov 08 18:30:07 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:30:07 user nova-compute[74820]:     </disk>
Nov 08 18:30:07 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:30:07 user nova-compute[74820]:       <mac address="fa:16:3e:99:85:47"/>
Nov 08 18:30:07 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:30:07 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:30:07 user nova-compute[74820]:       <target dev="tap99bf6bcf-2c"/>
Nov 08 18:30:07 user nova-compute[74820]:     </interface>
Nov 08 18:30:07 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:30:07 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/console.log" append="off"/>
Nov 08 18:30:07 user nova-compute[74820]:     </serial>
Nov 08 18:30:07 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:30:07 user nova-compute[74820]:     <video>
Nov 08 18:30:07 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:30:07 user nova-compute[74820]:     </video>
Nov 08 18:30:07 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:30:07 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:30:07 user nova-compute[74820]:     </rng>
Nov 08 18:30:07 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:30:07 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:30:07 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:30:07 user nova-compute[74820]:     </memballoon>
Nov 08 18:30:07 user nova-compute[74820]:   </devices>
Nov 08 18:30:07 user nova-compute[74820]: </domain>
Nov 08 18:30:07 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-929490939',display_name='tempest-AttachVolumeNegativeTest-server-929490939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-929490939',id=13,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcmuSkw2lVgZLTqICtcZJHJKfuZCHmE3MHdsPUZvUz1+czR3blcZWG3BB/sPistMwWSqzbeo5GbsE8J7jPSxexLH7zHo9hDYoTDfzmAUXRvKBkAUD9n1t0ZN86i3yhDqA==',key_name='tempest-keypair-1178429342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-d0f240kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=03b7e5da-f78f-423f-9e8d-77588b710547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG os_vif [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02b73a1f-850e-52a9-9f4e-6601b4842018', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bf6bcf-2c, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bf6bcf-2c, col_values=(('qos', UUID('d6bf4a96-fed0-4deb-9031-9d2189cd4f75')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bf6bcf-2c, col_values=(('external_ids', {'iface-id': '99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:85:47', 'vm-uuid': '03b7e5da-f78f-423f-9e8d-77588b710547'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:07 user nova-compute[74820]: INFO os_vif [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c')
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No VIF found with MAC fa:16:3e:99:85:47, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Updated VIF entry in instance network info cache for port 99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Updating instance_info_cache with network_info: [{"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: e6dbeff1-7811-4223-a3b0-a69036de1732 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-07c87dbc-7e06-412e-8964-6272ee24a58d req-9f871298-782d-4582-a03e-8971a96af0fd service nova] Releasing lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-e6dbeff1-7811-4223-a3b0-a69036de1732 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-e6dbeff1-7811-4223-a3b0-a69036de1732. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port e6dbeff1-7811-4223-a3b0-a69036de1732 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-08a8feaa-d165-4791-83bc-47fe069ddfed req-9655cffd-df57-432e-9845-aaba8ccc2ea5 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: 51d5970a-86ec-4a83-aed9-85a818399279 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: eed6851b-694d-4a19-851d-aaa52d0854b0 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-40426eca-f364-43d9-a9dd-20a0598355e2 req-2cf389e8-3dd6-4726-bbba-b1c668084fb5 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40426eca-f364-43d9-a9dd-20a0598355e2 req-2cf389e8-3dd6-4726-bbba-b1c668084fb5 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40426eca-f364-43d9-a9dd-20a0598355e2 req-2cf389e8-3dd6-4726-bbba-b1c668084fb5 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40426eca-f364-43d9-a9dd-20a0598355e2 req-2cf389e8-3dd6-4726-bbba-b1c668084fb5 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-40426eca-f364-43d9-a9dd-20a0598355e2 req-2cf389e8-3dd6-4726-bbba-b1c668084fb5 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:30:09 user nova-compute[74820]: WARNING nova.compute.manager [req-40426eca-f364-43d9-a9dd-20a0598355e2 req-2cf389e8-3dd6-4726-bbba-b1c668084fb5 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state building and task_state spawning.
Nov 08 18:30:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: 2bbaabd7-077f-4b83-9e65-a127b740ff98 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-51d5970a-86ec-4a83-aed9-85a818399279 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-51d5970a-86ec-4a83-aed9-85a818399279. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port 51d5970a-86ec-4a83-aed9-85a818399279 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-eed6851b-694d-4a19-851d-aaa52d0854b0 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-eed6851b-694d-4a19-851d-aaa52d0854b0. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port eed6851b-694d-4a19-851d-aaa52d0854b0 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: 8a9f1bf6-f57b-4c14-9120-6e6448516d4d {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-2bbaabd7-077f-4b83-9e65-a127b740ff98 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-2bbaabd7-077f-4b83-9e65-a127b740ff98. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port 2bbaabd7-077f-4b83-9e65-a127b740ff98 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bc3e2eb2-a2ac-4502-8859-7b7988345786 req-dd92eee7-92e3-4e92-adc4-5fb592ce4ff7 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:30:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Instance spawned successfully.
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: 472e91c7-b54d-45df-87ca-4afbda52653a {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-6b956e57-b679-4dfd-ba07-c52c78a40372 req-5945e83e-5a35-4599-beaa-e17455d1ec62 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6b956e57-b679-4dfd-ba07-c52c78a40372 req-5945e83e-5a35-4599-beaa-e17455d1ec62 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6b956e57-b679-4dfd-ba07-c52c78a40372 req-5945e83e-5a35-4599-beaa-e17455d1ec62 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6b956e57-b679-4dfd-ba07-c52c78a40372 req-5945e83e-5a35-4599-beaa-e17455d1ec62 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-6b956e57-b679-4dfd-ba07-c52c78a40372 req-5945e83e-5a35-4599-beaa-e17455d1ec62 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:30:11 user nova-compute[74820]: WARNING nova.compute.manager [req-6b956e57-b679-4dfd-ba07-c52c78a40372 req-5945e83e-5a35-4599-beaa-e17455d1ec62 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state building and task_state spawning.
Nov 08 18:30:11 user nova-compute[74820]: INFO nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:30:11 user nova-compute[74820]: INFO nova.compute.manager [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Took 6.88 seconds to build instance.
Nov 08 18:30:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ebe95ba9-8bef-4408-99bd-026ada3a3a9a tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "03b7e5da-f78f-423f-9e8d-77588b710547" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.982s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-8a9f1bf6-f57b-4c14-9120-6e6448516d4d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-8a9f1bf6-f57b-4c14-9120-6e6448516d4d. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port 8a9f1bf6-f57b-4c14-9120-6e6448516d4d {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Successfully updated port: 1a63188e-a8b1-436a-a767-25ba732d9a6f {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-472e91c7-b54d-45df-87ca-4afbda52653a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-472e91c7-b54d-45df-87ca-4afbda52653a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port 472e91c7-b54d-45df-87ca-4afbda52653a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3ba07347-cbb0-47b5-bc11-6173af9b85c5 req-409f66f0-5b86-4b36-ae4a-505a841db533 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:30:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Received event network-changed-1a63188e-a8b1-436a-a767-25ba732d9a6f {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing instance network info cache due to event network-changed-1a63188e-a8b1-436a-a767-25ba732d9a6f. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:30:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] Acquiring lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [{"id": "e6dbeff1-7811-4223-a3b0-a69036de1732", "address": "fa:16:3e:29:c5:1d", "network": {"id": "726a00f0-2b99-41fb-9d05-ffd33076863e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1599146638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dbeff1-78", "ovs_interfaceid": "e6dbeff1-7811-4223-a3b0-a69036de1732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51d5970a-86ec-4a83-aed9-85a818399279", "address": "fa:16:3e:0f:ab:41", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d5970a-86", "ovs_interfaceid": "51d5970a-86ec-4a83-aed9-85a818399279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eed6851b-694d-4a19-851d-aaa52d0854b0", "address": "fa:16:3e:ab:30:c9", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed6851b-69", "ovs_interfaceid": "eed6851b-694d-4a19-851d-aaa52d0854b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "address": "fa:16:3e:19:78:92", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbaabd7-07", "ovs_interfaceid": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "address": "fa:16:3e:1c:e6:08", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9f1bf6-f5", "ovs_interfaceid": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472e91c7-b54d-45df-87ca-4afbda52653a", "address": "fa:16:3e:de:95:4c", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472e91c7-b5", "ovs_interfaceid": "472e91c7-b54d-45df-87ca-4afbda52653a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "address": "fa:16:3e:c3:ca:cc", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a63188e-a8", "ovs_interfaceid": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance network_info: |[{"id": "e6dbeff1-7811-4223-a3b0-a69036de1732", "address": "fa:16:3e:29:c5:1d", "network": {"id": "726a00f0-2b99-41fb-9d05-ffd33076863e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1599146638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dbeff1-78", "ovs_interfaceid": "e6dbeff1-7811-4223-a3b0-a69036de1732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51d5970a-86ec-4a83-aed9-85a818399279", "address": "fa:16:3e:0f:ab:41", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d5970a-86", "ovs_interfaceid": "51d5970a-86ec-4a83-aed9-85a818399279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eed6851b-694d-4a19-851d-aaa52d0854b0", "address": "fa:16:3e:ab:30:c9", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed6851b-69", "ovs_interfaceid": "eed6851b-694d-4a19-851d-aaa52d0854b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "address": "fa:16:3e:19:78:92", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbaabd7-07", "ovs_interfaceid": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "address": "fa:16:3e:1c:e6:08", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9f1bf6-f5", "ovs_interfaceid": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472e91c7-b54d-45df-87ca-4afbda52653a", "address": "fa:16:3e:de:95:4c", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472e91c7-b5", "ovs_interfaceid": "472e91c7-b54d-45df-87ca-4afbda52653a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "address": "fa:16:3e:c3:ca:cc", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a63188e-a8", "ovs_interfaceid": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:30:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] Acquired lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Refreshing network info cache for port 1a63188e-a8b1-436a-a767-25ba732d9a6f {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:30:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updated VIF entry in instance network info cache for port 1a63188e-a8b1-436a-a767-25ba732d9a6f. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:30:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [{"id": "e6dbeff1-7811-4223-a3b0-a69036de1732", "address": "fa:16:3e:29:c5:1d", "network": {"id": "726a00f0-2b99-41fb-9d05-ffd33076863e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1599146638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dbeff1-78", "ovs_interfaceid": "e6dbeff1-7811-4223-a3b0-a69036de1732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51d5970a-86ec-4a83-aed9-85a818399279", "address": "fa:16:3e:0f:ab:41", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d5970a-86", "ovs_interfaceid": "51d5970a-86ec-4a83-aed9-85a818399279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eed6851b-694d-4a19-851d-aaa52d0854b0", "address": "fa:16:3e:ab:30:c9", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed6851b-69", "ovs_interfaceid": "eed6851b-694d-4a19-851d-aaa52d0854b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "address": "fa:16:3e:19:78:92", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbaabd7-07", "ovs_interfaceid": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "address": "fa:16:3e:1c:e6:08", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9f1bf6-f5", "ovs_interfaceid": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "472e91c7-b54d-45df-87ca-4afbda52653a", "address": "fa:16:3e:de:95:4c", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472e91c7-b5", "ovs_interfaceid": "472e91c7-b54d-45df-87ca-4afbda52653a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "address": "fa:16:3e:c3:ca:cc", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a63188e-a8", "ovs_interfaceid": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9580f2d-6278-4484-b2c5-0940b6c6b28d req-97f937a5-0651-48ad-8dc0-6683744546d8 service nova] Releasing lock "refresh_cache-b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:30:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:30:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:30:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:30:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:30:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:23 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 is timed out.
Nov 08 18:30:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Successfully detached device sdc from instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02 from the live domain config.
Nov 08 18:30:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yTgdLVKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:23 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e9ade0-c06e-420d-80b7-6fc6ca0141ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:30:23 user nova-compute[74820]: No targets found.
Nov 08 18:30:23 user nova-compute[74820]: iSNS:
Nov 08 18:30:23 user nova-compute[74820]: No targets found.
Nov 08 18:30:23 user nova-compute[74820]: STATIC:
Nov 08 18:30:23 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:30:23 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:23 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:23 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c
Nov 08 18:30:23 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:23 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:23 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc
Nov 08 18:30:23 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:23 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:23 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79
Nov 08 18:30:23 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:23 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:23 user nova-compute[74820]: FIRMWARE:
Nov 08 18:30:23 user nova-compute[74820]: No targets found.
Nov 08 18:30:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:30:23 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:30:23 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[589eefed-a95e-4f7d-9073-f8b589335b55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bac91d-f366-4d2d-90e5-68b11cfcc8de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:23 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:23 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:23 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:23 user nova-compute[74820]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c (non-flash)
Nov 08 18:30:23 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:23 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28732440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb913ac-2d8d-4975-a57f-7e72cc8564f1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2138d6e-c4fd-43e5-a343-3366591381e0]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8af6557-6d3f-406c-a97a-2f91fb9cc67e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e398d5-638d-4116-8f2a-16f89ee632f3]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b511a1-a886-4ca0-9f10-8afc7eef1c7e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c527ef86-ac6a-4e3b-9039-6fdfa74d53f2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260]
Nov 08 18:30:23 user nova-compute[74820]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c, portal: 172.16.0.220,3260] successful.
Nov 08 18:30:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210f9b90-e1b6-4560-8157-aa70c46d335c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9343ef67-322f-4b37-8a57-0c48a198f4fe]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] <== disconnect_volume: return (305ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDpJnjEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:26 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba35a6-8593-4b41-8e05-e92889945028]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:30:26 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0601c8fd-8607-4c35-b7cb-10eac894a06b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f] added
Nov 08 18:30:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8580f13-aef5-40c3-a239-ae825d885233]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47f0fd1-6392-4893-8eef-6dcbc4328bb8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDpJnjEK {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDpJnjEK" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8be54d-92d0-48e8-94cf-11f9a50c8fd4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZDpJnjEK'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eac35d-dbcd-47c7-9df9-b4c28e4d4f9a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0238a-1b6a-45c1-b65c-1e4f216afcab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[784af06d-250c-4085-a74f-d88c423db4f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260]
Nov 08 18:30:26 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260] successful.
Nov 08 18:30:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4848f0-dc93-4192-a311-11f41b6edc79]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc65efca-3fab-4e24-aa4a-283cb3424810]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:26 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdcfeb3-a4b9-4da5-9ba4-a18d84cc2002]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDpJnjEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23864663438643532', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864663438643532', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'flavor' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:30:27 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:27 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:30:27 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:27 user nova-compute[74820]:   <serial>3ed1c86f-0e07-4d30-a45c-4acb4864949f</serial>
Nov 08 18:30:27 user nova-compute[74820]: </disk>
Nov 08 18:30:27 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:30:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No BDM found with device name hda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:30:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] No VIF found with MAC fa:16:3e:f5:43:e0, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:30:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afc7d279-466d-423e-b507-7d51b9ca4e7a tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.607s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lazy-loading 'flavor' on Instance uuid 818ce0ba-7664-4625-9cc9-45a46d4a2e02 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d7de474-ea92-4a0d-923f-0f49624fed2b tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.542s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ec0944a6-951d-42da-a92e-bf37ee7bf43d tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.824s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:31 user nova-compute[74820]: INFO nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Booting with volume 16b300d3-6730-4212-9816-1ab558149fd6 at /dev/vdb
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.volume.cinder [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Update attachment failed for attachment d9f02c91-bece-4ca1-8398-8396c1b48f5b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Traceback (most recent call last):
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     driver_block_device.attach_block_devices(
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     _log_and_attach(device)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     self._do_attach(context, instance, volume, volume_api,
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     self._volume_attach(context, volume, connector, instance,
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     connection_info = volume_api.attachment_update(
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     res = method(self, ctx, *args, **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     with excutils.save_and_reraise_exception():
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     self.force_reraise()
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     raise self.value
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     return method.func(obj, *args, **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     resp = self._update('/attachments/%s' % id, body)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     return self.request(url, method, **kwargs)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9]     raise exceptions.from_response(resp, body)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c)
Nov 08 18:30:31 user nova-compute[74820]: ERROR nova.compute.manager [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] 
Nov 08 18:30:31 user nova-compute[74820]: DEBUG nova.compute.claims [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Aborting claim: <nova.compute.claims.Claim object at 0x7f3e40235930> {{(pid=74820) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.utils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bbb37a-2c4d-491f-9dc5-cc39e825a1da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d474a-1a80-4b57-b049-6f855b5fbf00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0692f3a-dfee-4fdf-accf-792b765d9bd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c51eef6-e90c-4f83-8d74-86ac20912d14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.utils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[432154dc-1946-4281-941e-4aa3829bdfc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:31 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8458ece-cd4c-4363-b8aa-8b4c1ae2ab66]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG os_brick.utils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating existing volume attachment record: b645969c-2547-4ce8-933a-419b46a5bb1e {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:30:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f968e71-607c-4ff0-961d-99139ea861a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d0216b-5ede-41f4-8c90-5f7f7f657234]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84735fc-a8d6-4f08-8c74-71415e63db12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] volume_snapshot_create: create_info: {'snapshot_id': 'b30a7247-9925-490d-bd5f-b30154fe695d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74820) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:30:32 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca3983-671b-46e8-af52-0bcfa347f8e3]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] snap xml: <domainsnapshot>
Nov 08 18:30:32 user nova-compute[74820]:   <disks>
Nov 08 18:30:32 user nova-compute[74820]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 08 18:30:32 user nova-compute[74820]:       <source file="/dev/new_file"/>
Nov 08 18:30:32 user nova-compute[74820]:     </disk>
Nov 08 18:30:32 user nova-compute[74820]:     <disk name="vda" snapshot="no"/>
Nov 08 18:30:32 user nova-compute[74820]:   </disks>
Nov 08 18:30:32 user nova-compute[74820]: </domainsnapshot>
Nov 08 18:30:32 user nova-compute[74820]:  {{(pid=74820) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] Lazy-loading 'system_metadata' on Instance uuid c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating existing volume attachment record: dbd8e099-f1a4-4bbe-953a-5b823626de17 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-cb0ef76a-4d2e-4502-8d06-1bc328083c00 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] volume_snapshot_delete: delete_info: {'volume_id': '38f36f35-b638-48ca-b9b1-ad31b45d5d79'} {{(pid=74820) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [None req-cb0ef76a-4d2e-4502-8d06-1bc328083c00 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Traceback (most recent call last):
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     if delete_info['type'] != 'qcow2':
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] KeyError: 'type'
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] 
Nov 08 18:30:32 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Traceback (most recent call last):
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     rv = execute(f, *args, **kwargs)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     six.reraise(c, e, tb)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     raise value
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     rv = meth(*args, **kwargs)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] 
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Traceback (most recent call last):
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     self._volume_snapshot_create(context, instance, guest,
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     rv = execute(f, *args, **kwargs)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     six.reraise(c, e, tb)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     raise value
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     rv = meth(*args, **kwargs)
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] 
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:32 user nova-compute[74820]: INFO nova.compute.manager [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Terminating instance
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.785s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Build of instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c) {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.utils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Build of instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74820) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 18:30:32 user nova-compute[74820]: ERROR nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Build of instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c): nova.exception.BuildAbortException: Build of instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2fe132e6-83ba-40c5-b06a-6608b3f4299c)
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Unplugging VIFs for instance {{(pid=74820) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24054ffb-55bd-4c9c-933f-ac134b12d223", "address": "fa:16:3e:b1:7d:90", "network": {"id": "78380ca1-7219-4330-9d40-a8b4c6a1f72f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2053709143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24054ffb-55", "ovs_interfaceid": "24054ffb-55bd-4c9c-933f-ac134b12d223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "24054ffb-55bd-4c9c-933f-ac134b12d223", "address": "fa:16:3e:b1:7d:90", "network": {"id": "78380ca1-7219-4330-9d40-a8b4c6a1f72f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2053709143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24054ffb-55", "ovs_interfaceid": "24054ffb-55bd-4c9c-933f-ac134b12d223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=24054ffb-55bd-4c9c-933f-ac134b12d223,network=Network(78380ca1-7219-4330-9d40-a8b4c6a1f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24054ffb-55') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=24054ffb-55bd-4c9c-933f-ac134b12d223,network=Network(78380ca1-7219-4330-9d40-a8b4c6a1f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24054ffb-55') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24054ffb-55, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7d:90,bridge_name='br-int',has_traffic_filtering=True,id=24054ffb-55bd-4c9c-933f-ac134b12d223,network=Network(78380ca1-7219-4330-9d40-a8b4c6a1f72f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24054ffb-55')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "address": "fa:16:3e:1a:db:e5", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f9a9f-55", "ovs_interfaceid": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "address": "fa:16:3e:1a:db:e5", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f9a9f-55", "ovs_interfaceid": "907f9a9f-55b2-413b-8207-2d3786c7cfc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:db:e5,bridge_name='br-int',has_traffic_filtering=True,id=907f9a9f-55b2-413b-8207-2d3786c7cfc8,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap907f9a9f-55') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:db:e5,bridge_name='br-int',has_traffic_filtering=True,id=907f9a9f-55b2-413b-8207-2d3786c7cfc8,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap907f9a9f-55') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap907f9a9f-55, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:db:e5,bridge_name='br-int',has_traffic_filtering=True,id=907f9a9f-55b2-413b-8207-2d3786c7cfc8,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap907f9a9f-55')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "address": "fa:16:3e:80:3c:a3", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9113d5-a9", "ovs_interfaceid": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "address": "fa:16:3e:80:3c:a3", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9113d5-a9", "ovs_interfaceid": "9f9113d5-a97e-46b0-86b5-2ef805dd58eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:3c:a3,bridge_name='br-int',has_traffic_filtering=True,id=9f9113d5-a97e-46b0-86b5-2ef805dd58eb,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f9113d5-a9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:3c:a3,bridge_name='br-int',has_traffic_filtering=True,id=9f9113d5-a97e-46b0-86b5-2ef805dd58eb,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f9113d5-a9') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f9113d5-a9, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:3c:a3,bridge_name='br-int',has_traffic_filtering=True,id=9f9113d5-a97e-46b0-86b5-2ef805dd58eb,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f9113d5-a9')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a77b9b-5642-4f25-b323-d28ae21ef125", "address": "fa:16:3e:c7:09:44", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a77b9b-56", "ovs_interfaceid": "02a77b9b-5642-4f25-b323-d28ae21ef125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "02a77b9b-5642-4f25-b323-d28ae21ef125", "address": "fa:16:3e:c7:09:44", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a77b9b-56", "ovs_interfaceid": "02a77b9b-5642-4f25-b323-d28ae21ef125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:44,bridge_name='br-int',has_traffic_filtering=True,id=02a77b9b-5642-4f25-b323-d28ae21ef125,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a77b9b-56') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:44,bridge_name='br-int',has_traffic_filtering=True,id=02a77b9b-5642-4f25-b323-d28ae21ef125,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a77b9b-56') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02a77b9b-56, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:09:44,bridge_name='br-int',has_traffic_filtering=True,id=02a77b9b-5642-4f25-b323-d28ae21ef125,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a77b9b-56')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "address": "fa:16:3e:cd:f4:25", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7a7a14-9c", "ovs_interfaceid": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "address": "fa:16:3e:cd:f4:25", "network": {"id": "0f32aa83-714e-4224-a207-f9b21fa159de", "bridge": "br-int", "label": "tempest-device-tagging-net1-838170933", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7a7a14-9c", "ovs_interfaceid": "3a7a7a14-9c7e-4601-87e3-5459f866ab4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f4:25,bridge_name='br-int',has_traffic_filtering=True,id=3a7a7a14-9c7e-4601-87e3-5459f866ab4b,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7a7a14-9c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f4:25,bridge_name='br-int',has_traffic_filtering=True,id=3a7a7a14-9c7e-4601-87e3-5459f866ab4b,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7a7a14-9c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a7a7a14-9c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f4:25,bridge_name='br-int',has_traffic_filtering=True,id=3a7a7a14-9c7e-4601-87e3-5459f866ab4b,network=Network(0f32aa83-714e-4224-a207-f9b21fa159de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7a7a14-9c')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "address": "fa:16:3e:17:75:50", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ce0b8-0b", "ovs_interfaceid": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "address": "fa:16:3e:17:75:50", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ce0b8-0b", "ovs_interfaceid": "5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:75:50,bridge_name='br-int',has_traffic_filtering=True,id=5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800,network=Network(2138b78c-16f6-489b-8972-176b2d6f6f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0ce0b8-0b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:75:50,bridge_name='br-int',has_traffic_filtering=True,id=5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800,network=Network(2138b78c-16f6-489b-8972-176b2d6f6f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0ce0b8-0b') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d0ce0b8-0b, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:75:50,bridge_name='br-int',has_traffic_filtering=True,id=5d0ce0b8-0b56-40e0-9d6b-07bd9cd1b800,network=Network(2138b78c-16f6-489b-8972-176b2d6f6f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d0ce0b8-0b')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1544452275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1544452275',id=10,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLKIqEEz7LJb78nQmVZA4BYFrHwb17oHGLcB4yG41snXh4L8KRBg3RQQEgF4YhrOObFU33Crdf+jSQMmL/ygKa/9MFbmZFLOy6dDHowSJwKhGpgEXNgTFqhQmXEOzCJlA==',key_name='tempest-keypair-754388221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32b915018e814881844297432ef6d86f',ramdisk_id='',reservation_id='r-60audosq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1376636969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1376636969-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ba533d7f9174c5fa897d608ca9461d0',uuid=8916abda-c9a1-4dd6-b70d-f94f430a09e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "address": "fa:16:3e:52:e6:83", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ff28e2-3c", "ovs_interfaceid": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converting VIF {"id": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "address": "fa:16:3e:52:e6:83", "network": {"id": "2138b78c-16f6-489b-8972-176b2d6f6f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-146764526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32b915018e814881844297432ef6d86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ff28e2-3c", "ovs_interfaceid": "78ff28e2-3cf0-4c61-a91b-13c054ac8899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:83,bridge_name='br-int',has_traffic_filtering=True,id=78ff28e2-3cf0-4c61-a91b-13c054ac8899,network=Network(2138b78c-16f6-489b-8972-176b2d6f6f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ff28e2-3c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:83,bridge_name='br-int',has_traffic_filtering=True,id=78ff28e2-3cf0-4c61-a91b-13c054ac8899,network=Network(2138b78c-16f6-489b-8972-176b2d6f6f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ff28e2-3c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ff28e2-3c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:30:32 user nova-compute[74820]: INFO os_vif [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:83,bridge_name='br-int',has_traffic_filtering=True,id=78ff28e2-3cf0-4c61-a91b-13c054ac8899,network=Network(2138b78c-16f6-489b-8972-176b2d6f6f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ff28e2-3c')
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Unplugged VIFs for instance {{(pid=74820) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-ba076022-075c-492e-bac1-1d1213efb870 req-7c92f26d-f8b8-4beb-ba24-136e7732ef5b service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-vif-unplugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ba076022-075c-492e-bac1-1d1213efb870 req-7c92f26d-f8b8-4beb-ba24-136e7732ef5b service nova] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ba076022-075c-492e-bac1-1d1213efb870 req-7c92f26d-f8b8-4beb-ba24-136e7732ef5b service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ba076022-075c-492e-bac1-1d1213efb870 req-7c92f26d-f8b8-4beb-ba24-136e7732ef5b service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-ba076022-075c-492e-bac1-1d1213efb870 req-7c92f26d-f8b8-4beb-ba24-136e7732ef5b service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] No waiting events found dispatching network-vif-unplugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:30:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-ba076022-075c-492e-bac1-1d1213efb870 req-7c92f26d-f8b8-4beb-ba24-136e7732ef5b service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-vif-unplugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:30:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Instance destroyed successfully.
Nov 08 18:30:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lazy-loading 'resources' on Instance uuid 818ce0ba-7664-4625-9cc9-45a46d4a2e02 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-842160497',display_name='tempest-AttachSCSIVolumeTestJSON-server-842160497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-842160497',id=6,image_ref='d0463fd2-557b-4320-a9a6-ac1c8c1024ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLgO9gtrtjMO0xyB3Y10buR5MAi4T2fio6wYyYdIxTmeUy3qOXzjV4T05TkANv5zJErpoL3G+yZ5+JZAFXp+ANwzGc/DHkN8MZJSxDWlPDEGeCcOczPPmFmWDYQ94Twgw==',key_name='tempest-keypair-1665980508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f56aa0d597f4404fbbe0da7ee83cb9ca',ramdisk_id='',reservation_id='r-ut1m4dei',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d0463fd2-557b-4320-a9a6-ac1c8c1024ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-781876229',owner_user_name='tempest-AttachSCSIVolumeTestJSON-781876229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e92151f626b44a96b7974667d9e62217',uuid=818ce0ba-7664-4625-9cc9-45a46d4a2e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Converting VIF {"id": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "address": "fa:16:3e:e3:c9:38", "network": {"id": "0ffc5059-e1ed-425d-ad12-a91e4fab7400", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1668457938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f56aa0d597f4404fbbe0da7ee83cb9ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cf1ca9-4e", "ovs_interfaceid": "b9cf1ca9-4e85-46fd-93b1-f5a68165949c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG os_vif [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9cf1ca9-4e, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c2c9b8f-4d9f-42d4-8e4e-708d7c34a68a) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:30:33 user nova-compute[74820]: INFO os_vif [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=b9cf1ca9-4e85-46fd-93b1-f5a68165949c,network=Network(0ffc5059-e1ed-425d-ad12-a91e4fab7400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cf1ca9-4e')
Nov 08 18:30:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Deleting instance files /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02_del
Nov 08 18:30:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Deletion of /opt/stack/data/nova/instances/818ce0ba-7664-4625-9cc9-45a46d4a2e02_del complete
Nov 08 18:30:33 user nova-compute[74820]: INFO nova.compute.manager [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 18:30:33 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:30:33 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:34 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Took 1.19 seconds to deallocate network for instance.
Nov 08 18:30:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-1229bd4c-8516-464e-bc7d-2a2a284f3edb req-296914c2-38b4-4eb9-8b48-f7672bac01d7 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-vif-deleted-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-d924504f-dfd5-4896-aec0-c79e8cf8f7d7 req-baf5d1d0-df07-495a-b975-1d892b737c75 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received event network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d924504f-dfd5-4896-aec0-c79e8cf8f7d7 req-baf5d1d0-df07-495a-b975-1d892b737c75 service nova] Acquiring lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d924504f-dfd5-4896-aec0-c79e8cf8f7d7 req-baf5d1d0-df07-495a-b975-1d892b737c75 service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d924504f-dfd5-4896-aec0-c79e8cf8f7d7 req-baf5d1d0-df07-495a-b975-1d892b737c75 service nova] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-d924504f-dfd5-4896-aec0-c79e8cf8f7d7 req-baf5d1d0-df07-495a-b975-1d892b737c75 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] No waiting events found dispatching network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:30:34 user nova-compute[74820]: WARNING nova.compute.manager [req-d924504f-dfd5-4896-aec0-c79e8cf8f7d7 req-baf5d1d0-df07-495a-b975-1d892b737c75 service nova] [instance: 818ce0ba-7664-4625-9cc9-45a46d4a2e02] Received unexpected event network-vif-plugged-b9cf1ca9-4e85-46fd-93b1-f5a68165949c for instance with vm_state deleted and task_state None.
Nov 08 18:30:34 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Deleted allocations for instance 818ce0ba-7664-4625-9cc9-45a46d4a2e02
Nov 08 18:30:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c7ed9ebb-59ee-4f6c-b399-6d32bcca13a8 tempest-AttachSCSIVolumeTestJSON-781876229 tempest-AttachSCSIVolumeTestJSON-781876229-project-member] Lock "818ce0ba-7664-4625-9cc9-45a46d4a2e02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.675s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:36 user nova-compute[74820]: DEBUG nova.network.neutron [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:36 user nova-compute[74820]: INFO nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Took 3.75 seconds to deallocate network for instance.
Nov 08 18:30:36 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Detaching volume: 8f5c45d8-d1a7-44c4-a169-358e252ce9c2 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:30:36 user nova-compute[74820]: INFO nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Detaching volume 8f5c45d8-d1a7-44c4-a169-358e252ce9c2
Nov 08 18:30:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:41 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:42 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:30:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:30:46 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:30:46 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7954MB free_disk=25.444801330566406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e55b6e6b-6928-407d-b147-aa912277ec71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 133d6dc8-9328-4831-a247-d655d91d32a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 03b7e5da-f78f-423f-9e8d-77588b710547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:30:46 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:30:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:30:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:30:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvIhlqVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '133d6dc8-9328-4831-a247-d655d91d32a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3577301-887e-4294-a6fa-000e62e95c85', 'serial': 'f3577301-887e-4294-a6fa-000e62e95c85'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '133d6dc8-9328-4831-a247-d655d91d32a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'serial'} {{(pid=74820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvIhlqVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:51 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:51 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:51 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73f945a-7cbb-49db-9ed3-a29944bc9236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:30:51 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e47283-5f86-4c2a-9200-e539b4314457]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85] added
Nov 08 18:30:51 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d03f8-8e79-4850-908f-d1f70cb785f4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8147b08e-dd12-4f0e-9928-034ad223fe46]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvIhlqVj {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [None req-cb0ef76a-4d2e-4502-8d06-1bc328083c00 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6a737913-29b0-42d0-a233-435da24427f9)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server [None req-cb0ef76a-4d2e-4502-8d06-1bc328083c00 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] Exception during message handling: KeyError: 'type'
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server 
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvIhlqVj" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0aaa4e-f76d-460d-abc0-371e793ed2a5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvIhlqVj'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b30a7247-9925-490d-bd5f-b30154fe695d could not be found.
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b30a7247-9925-490d-bd5f-b30154fe695d could not be found. (HTTP 404) (Request-ID: req-ea737f42-4e2d-4ac7-8b08-311e64b7cf4d)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b30a7247-9925-490d-bd5f-b30154fe695d could not be found.
Nov 08 18:30:51 user nova-compute[74820]: ERROR nova.virt.libvirt.driver 
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server [None req-41859054-24be-4475-a028-f255bb7ddc95 tempest-VolumesAssistedSnapshotsTest-25338984 tempest-VolumesAssistedSnapshotsTest-25338984-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 18:30:51 user nova-compute[74820]: ERROR oslo_messaging.rpc.server 
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee1964-3065-4645-8f28-706ab3d3b069]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958d376-408a-4d13-98d0-66a7748bf5fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:51 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:51 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:51 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:51 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:51 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:51 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:51 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:51 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df67b29-76d6-4875-9bd8-d1462d0cc28e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260]
Nov 08 18:30:51 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260] successful.
Nov 08 18:30:51 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8261aa1a-b12d-48b8-9a51-3acf9c29e71a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b5df2-ccfd-40db-aef1-0c62c6cba968]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:30:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:52 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:30:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[360d18f3-321f-4830-970e-6032a278d9e2]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvIhlqVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Skipping driver_detach during remote rebuild. {{(pid=74820) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 18:30:52 user nova-compute[74820]: INFO nova.compute.manager [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Detaching volume 3ed1c86f-0e07-4d30-a45c-4acb4864949f
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:52 user nova-compute[74820]: INFO nova.compute.manager [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Detaching volume 38f36f35-b638-48ca-b9b1-ad31b45d5d79
Nov 08 18:30:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26231313235626365', 'path': '/dev/sdf'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231313235626365', 'path': '/dev/sdf'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:30:53 user nova-compute[74820]: DEBUG nova.objects.instance [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lazy-loading 'flavor' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:30:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 22020096 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:54 user nova-compute[74820]: WARNING nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Failed to detach volume: 8f5c45d8-d1a7-44c4-a169-358e252ce9c2 due to 'NoneType' object has no attribute 'devices'
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Detaching volume: f871047b-86c5-4899-86ba-56563ce2c5f3 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:30:54 user nova-compute[74820]: INFO nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Detaching volume f871047b-86c5-4899-86ba-56563ce2c5f3
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 161480704 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:54 user nova-compute[74820]: INFO nova.virt.block_device [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Attempting to driver detach volume 3ed1c86f-0e07-4d30-a45c-4acb4864949f from mountpoint /dev/vdb
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Attempting to detach device vdb from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:30:54 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:54 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:30:54 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:54 user nova-compute[74820]:   <serial>3ed1c86f-0e07-4d30-a45c-4acb4864949f</serial>
Nov 08 18:30:54 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 18:30:54 user nova-compute[74820]: </disk>
Nov 08 18:30:54 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:30:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully detached device vdb from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the persistent domain config.
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:30:54 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:54 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:30:54 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:54 user nova-compute[74820]:   <serial>3ed1c86f-0e07-4d30-a45c-4acb4864949f</serial>
Nov 08 18:30:54 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 18:30:54 user nova-compute[74820]: </disk>
Nov 08 18:30:54 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:30:54 user nova-compute[74820]: INFO nova.virt.block_device [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Attempting to driver detach volume 38f36f35-b638-48ca-b9b1-ad31b45d5d79 from mountpoint /dev/vdb
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Attempting to detach device vdb from instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 18:30:54 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:54 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:30:54 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:54 user nova-compute[74820]:   <serial>38f36f35-b638-48ca-b9b1-ad31b45d5d79</serial>
Nov 08 18:30:54 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:30:54 user nova-compute[74820]: </disk>
Nov 08 18:30:54 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:30:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Successfully detached device vdb from instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 from the persistent domain config.
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:30:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 18:30:54 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:30:54 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:30:54 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:30:54 user nova-compute[74820]:   <serial>38f36f35-b638-48ca-b9b1-ad31b45d5d79</serial>
Nov 08 18:30:54 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:30:54 user nova-compute[74820]: </disk>
Nov 08 18:30:54 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:30:55 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Skipping driver_detach during remote rebuild. {{(pid=74820) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 18:30:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 276824064 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:30:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 396361728 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:30:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 533725184 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 671088640 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:30:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:30:57 user nova-compute[74820]: INFO nova.compute.claims [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Claim successful on node user
Nov 08 18:30:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 753926144 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 908066816 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.907s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 1044381696 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.policy [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a29988069fd43e0bfdb7b08a1fcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdef93b9fc745768902ae1afe39ae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:30:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Creating image(s)
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk 1073741824" returned: 0 in 0.059s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:30:59 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8261a2e-b953-4a98-a3a7-d2b356047ee7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:30:59 user nova-compute[74820]: No targets found.
Nov 08 18:30:59 user nova-compute[74820]: iSNS:
Nov 08 18:30:59 user nova-compute[74820]: No targets found.
Nov 08 18:30:59 user nova-compute[74820]: STATIC:
Nov 08 18:30:59 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:30:59 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:59 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:59 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85
Nov 08 18:30:59 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:59 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:59 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc
Nov 08 18:30:59 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:59 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:59 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79
Nov 08 18:30:59 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:59 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:59 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f
Nov 08 18:30:59 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:30:59 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:30:59 user nova-compute[74820]: FIRMWARE:
Nov 08 18:30:59 user nova-compute[74820]: No targets found.
Nov 08 18:30:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:30:59 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:30:59 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d071e014-2093-4c2c-9c6e-27560a985937]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201b0f9-f8b8-434c-8555-3edf652c05bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:30:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:30:59 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:30:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e283f0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc'): ({'sdd'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Removing single pathed devices sdd {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[163bcb13-6dad-4541-a0a2-c3057c76b64c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[742395e4-a14e-4077-ba44-174974fcf548]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Flushing IO for device /dev/sdd {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1023946e-348f-49fa-9a07-e16acf6ded2d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Successfully created port: 4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c7f9a7-e9da-450e-b97a-fd185d26db39]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] SCSI volumes sdd have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beada7b-4230-4f8f-bba0-da7e2a420ebe]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Cannot resize image /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Ensure instance console log exists: /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8111a1-cd53-4d0d-b6da-19b586ef1d84]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]
Nov 08 18:30:59 user nova-compute[74820]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.
Nov 08 18:30:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed714e7-326a-4a42-adaa-7723bf8afaf4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] <== disconnect_volume: return (402ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.volume.cinder [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Update attachment failed for attachment b645969c-2547-4ce8-933a-419b46a5bb1e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Traceback (most recent call last):
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     driver_block_device.attach_block_devices(
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     _log_and_attach(device)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     self._do_attach(context, instance, volume, volume_api,
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     self._volume_attach(context, volume, connector, instance,
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     connection_info = volume_api.attachment_update(
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     res = method(self, ctx, *args, **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     with excutils.save_and_reraise_exception():
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     self.force_reraise()
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     raise self.value
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     return method.func(obj, *args, **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     resp = self._update('/attachments/%s' % id, body)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     return self.request(url, method, **kwargs)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9]     raise exceptions.from_response(resp, body)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa)
Nov 08 18:30:59 user nova-compute[74820]: ERROR nova.compute.manager [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] 
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.compute.claims [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Aborting claim: <nova.compute.claims.Claim object at 0x7f3e40107910> {{(pid=74820) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Successfully updated port: 4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquired lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:30:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-changed-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Refreshing instance network info cache due to event network-changed-4564ddbd-d3fa-45cc-81a3-76e687daf8b6. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] Acquiring lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvIhlqVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '133d6dc8-9328-4831-a247-d655d91d32a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3577301-887e-4294-a6fa-000e62e95c85', 'serial'} {{(pid=74820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] swap_volume: removing Cinder connection for volume c97896dc-62f2-489c-9a8a-7b83093bd1dc {{(pid=74820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updating instance_info_cache with network_info: [{"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Releasing lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance network_info: |[{"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] Acquired lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.neutron [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Refreshing network info cache for port 4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Start _get_guest_xml network_info=[{"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:31:00 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:00 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-674409609',display_name='tempest-tempest.common.compute-instance-674409609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-674409609',id=14,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOyJSZaNwBdRj1hWE7uv2aBJY3g3C1v/eMFBUqPoGZMPW+a7ET03xsrCvH7D3VLG92nqRTg+wE3xk+rVA03MMCw0PZt/WhLbrYFQrzWlgDZ9P1DrK6EcLhnLTDNNa1HQA==',key_name='tempest-keypair-1672348396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-8rmn5v7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=42d369f9-f38b-4ddf-acb7-72f3f54f7f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.objects.instance [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'pci_devices' on Instance uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:31:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Creating image(s)
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Ensure instance console log exists: /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Start _get_guest_xml network_info=[{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'dbd8e099-f1a4-4bbe-953a-5b823626de17', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c51df6e9-c969-4869-88be-77c877029dde', 'attached_at': '', 'detached_at': '', 'volume_id': '862b48d8-4df9-4c26-8fa4-e927ecac302b', 'serial': '862b48d8-4df9-4c26-8fa4-e927ecac302b'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.683s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Build of instance b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa) {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.utils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Build of instance b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74820) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:31:00 user nova-compute[74820]:   <uuid>42d369f9-f38b-4ddf-acb7-72f3f54f7f8f</uuid>
Nov 08 18:31:00 user nova-compute[74820]:   <name>instance-0000000e</name>
Nov 08 18:31:00 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:31:00 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:31:00 user nova-compute[74820]:   <metadata>
Nov 08 18:31:00 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:00 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:31:00 user nova-compute[74820]:       <nova:name>tempest-tempest.common.compute-instance-674409609</nova:name>
Nov 08 18:31:00 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:31:00</nova:creationTime>
Nov 08 18:31:00 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:31:00 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:00 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:31:00 user nova-compute[74820]:       <nova:owner>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:user uuid="1a29988069fd43e0bfdb7b08a1fcc5d9">tempest-ServerActionsTestOtherA-600897548-project-member</nova:user>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:project uuid="4cdef93b9fc745768902ae1afe39ae4a">tempest-ServerActionsTestOtherA-600897548</nova:project>
Nov 08 18:31:00 user nova-compute[74820]:       </nova:owner>
Nov 08 18:31:00 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:00 user nova-compute[74820]:       <nova:ports>
Nov 08 18:31:00 user nova-compute[74820]:         <nova:port uuid="4564ddbd-d3fa-45cc-81a3-76e687daf8b6">
Nov 08 18:31:00 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 18:31:00 user nova-compute[74820]:         </nova:port>
Nov 08 18:31:00 user nova-compute[74820]:       </nova:ports>
Nov 08 18:31:00 user nova-compute[74820]:     </nova:instance>
Nov 08 18:31:00 user nova-compute[74820]:   </metadata>
Nov 08 18:31:00 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:31:00 user nova-compute[74820]:     <system>
Nov 08 18:31:00 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:31:00 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:31:00 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:31:00 user nova-compute[74820]:       <entry name="serial">42d369f9-f38b-4ddf-acb7-72f3f54f7f8f</entry>
Nov 08 18:31:00 user nova-compute[74820]:       <entry name="uuid">42d369f9-f38b-4ddf-acb7-72f3f54f7f8f</entry>
Nov 08 18:31:00 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:31:00 user nova-compute[74820]:     </system>
Nov 08 18:31:00 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:00 user nova-compute[74820]:   <os>
Nov 08 18:31:00 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:31:00 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:31:00 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:31:00 user nova-compute[74820]:   </os>
Nov 08 18:31:00 user nova-compute[74820]:   <features>
Nov 08 18:31:00 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:00 user nova-compute[74820]:     <apic/>
Nov 08 18:31:00 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:31:00 user nova-compute[74820]:   </features>
Nov 08 18:31:00 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:31:00 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:31:00 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:31:00 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:31:00 user nova-compute[74820]:   </clock>
Nov 08 18:31:00 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:31:00 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:31:00 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:31:00 user nova-compute[74820]:   </cpu>
Nov 08 18:31:00 user nova-compute[74820]:   <devices>
Nov 08 18:31:00 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:31:00 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:31:00 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk"/>
Nov 08 18:31:00 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:31:00 user nova-compute[74820]:     </disk>
Nov 08 18:31:00 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:31:00 user nova-compute[74820]:       <mac address="fa:16:3e:92:ce:7a"/>
Nov 08 18:31:00 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:31:00 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:31:00 user nova-compute[74820]:       <target dev="tap4564ddbd-d3"/>
Nov 08 18:31:00 user nova-compute[74820]:     </interface>
Nov 08 18:31:00 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:31:00 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/console.log" append="off"/>
Nov 08 18:31:00 user nova-compute[74820]:     </serial>
Nov 08 18:31:00 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:31:00 user nova-compute[74820]:     <video>
Nov 08 18:31:00 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:31:00 user nova-compute[74820]:     </video>
Nov 08 18:31:00 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:31:00 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:31:00 user nova-compute[74820]:     </rng>
Nov 08 18:31:00 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:31:00 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:31:00 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:31:00 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:00 user nova-compute[74820]:   </devices>
Nov 08 18:31:00 user nova-compute[74820]: </domain>
Nov 08 18:31:00 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-674409609',display_name='tempest-tempest.common.compute-instance-674409609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-674409609',id=14,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOyJSZaNwBdRj1hWE7uv2aBJY3g3C1v/eMFBUqPoGZMPW+a7ET03xsrCvH7D3VLG92nqRTg+wE3xk+rVA03MMCw0PZt/WhLbrYFQrzWlgDZ9P1DrK6EcLhnLTDNNa1HQA==',key_name='tempest-keypair-1672348396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-8rmn5v7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=42d369f9-f38b-4ddf-acb7-72f3f54f7f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:31:00 user nova-compute[74820]: ERROR nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Build of instance b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa): nova.exception.BuildAbortException: Build of instance b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d9860986-cf5e-420d-aa23-365d5a972dfa)
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Unplugging VIFs for instance {{(pid=74820) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6dbeff1-7811-4223-a3b0-a69036de1732", "address": "fa:16:3e:29:c5:1d", "network": {"id": "726a00f0-2b99-41fb-9d05-ffd33076863e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1599146638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dbeff1-78", "ovs_interfaceid": "e6dbeff1-7811-4223-a3b0-a69036de1732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "e6dbeff1-7811-4223-a3b0-a69036de1732", "address": "fa:16:3e:29:c5:1d", "network": {"id": "726a00f0-2b99-41fb-9d05-ffd33076863e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1599146638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6dbeff1-78", "ovs_interfaceid": "e6dbeff1-7811-4223-a3b0-a69036de1732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:1d,bridge_name='br-int',has_traffic_filtering=True,id=e6dbeff1-7811-4223-a3b0-a69036de1732,network=Network(726a00f0-2b99-41fb-9d05-ffd33076863e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dbeff1-78') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:1d,bridge_name='br-int',has_traffic_filtering=True,id=e6dbeff1-7811-4223-a3b0-a69036de1732,network=Network(726a00f0-2b99-41fb-9d05-ffd33076863e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dbeff1-78') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd4c6388-7965-560c-84e0-747d01c22a90', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6dbeff1-78, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4564ddbd-d3, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4564ddbd-d3, col_values=(('qos', UUID('fc5b0fdf-0c62-4c24-9367-e326742c5feb')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4564ddbd-d3, col_values=(('external_ids', {'iface-id': '4564ddbd-d3fa-45cc-81a3-76e687daf8b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:ce:7a', 'vm-uuid': '42d369f9-f38b-4ddf-acb7-72f3f54f7f8f'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:1d,bridge_name='br-int',has_traffic_filtering=True,id=e6dbeff1-7811-4223-a3b0-a69036de1732,network=Network(726a00f0-2b99-41fb-9d05-ffd33076863e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6dbeff1-78')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51d5970a-86ec-4a83-aed9-85a818399279", "address": "fa:16:3e:0f:ab:41", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d5970a-86", "ovs_interfaceid": "51d5970a-86ec-4a83-aed9-85a818399279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "51d5970a-86ec-4a83-aed9-85a818399279", "address": "fa:16:3e:0f:ab:41", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d5970a-86", "ovs_interfaceid": "51d5970a-86ec-4a83-aed9-85a818399279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=51d5970a-86ec-4a83-aed9-85a818399279,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51d5970a-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=51d5970a-86ec-4a83-aed9-85a818399279,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51d5970a-86') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:00 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:00 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51d5970a-86, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=51d5970a-86ec-4a83-aed9-85a818399279,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51d5970a-86')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed6851b-694d-4a19-851d-aaa52d0854b0", "address": "fa:16:3e:ab:30:c9", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed6851b-69", "ovs_interfaceid": "eed6851b-694d-4a19-851d-aaa52d0854b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "eed6851b-694d-4a19-851d-aaa52d0854b0", "address": "fa:16:3e:ab:30:c9", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed6851b-69", "ovs_interfaceid": "eed6851b-694d-4a19-851d-aaa52d0854b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:30:c9,bridge_name='br-int',has_traffic_filtering=True,id=eed6851b-694d-4a19-851d-aaa52d0854b0,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed6851b-69') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:30:c9,bridge_name='br-int',has_traffic_filtering=True,id=eed6851b-694d-4a19-851d-aaa52d0854b0,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed6851b-69') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeed6851b-69, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:30:c9,bridge_name='br-int',has_traffic_filtering=True,id=eed6851b-694d-4a19-851d-aaa52d0854b0,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeed6851b-69')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "address": "fa:16:3e:19:78:92", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbaabd7-07", "ovs_interfaceid": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "address": "fa:16:3e:19:78:92", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbaabd7-07", "ovs_interfaceid": "2bbaabd7-077f-4b83-9e65-a127b740ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:78:92,bridge_name='br-int',has_traffic_filtering=True,id=2bbaabd7-077f-4b83-9e65-a127b740ff98,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbaabd7-07') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:78:92,bridge_name='br-int',has_traffic_filtering=True,id=2bbaabd7-077f-4b83-9e65-a127b740ff98,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbaabd7-07') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bbaabd7-07, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:78:92,bridge_name='br-int',has_traffic_filtering=True,id=2bbaabd7-077f-4b83-9e65-a127b740ff98,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbaabd7-07')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "address": "fa:16:3e:1c:e6:08", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9f1bf6-f5", "ovs_interfaceid": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "address": "fa:16:3e:1c:e6:08", "network": {"id": "ab4a7e30-775c-40ac-8e65-efa612e7b67b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248287880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a9f1bf6-f5", "ovs_interfaceid": "8a9f1bf6-f57b-4c14-9120-6e6448516d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:08,bridge_name='br-int',has_traffic_filtering=True,id=8a9f1bf6-f57b-4c14-9120-6e6448516d4d,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9f1bf6-f5') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:08,bridge_name='br-int',has_traffic_filtering=True,id=8a9f1bf6-f57b-4c14-9120-6e6448516d4d,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9f1bf6-f5') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa366cde-b23a-493a-aa11-53b6bf77ffc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a9f1bf6-f5, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:31:00 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:e6:08,bridge_name='br-int',has_traffic_filtering=True,id=8a9f1bf6-f57b-4c14-9120-6e6448516d4d,network=Network(ab4a7e30-775c-40ac-8e65-efa612e7b67b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a9f1bf6-f5')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472e91c7-b54d-45df-87ca-4afbda52653a", "address": "fa:16:3e:de:95:4c", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472e91c7-b5", "ovs_interfaceid": "472e91c7-b54d-45df-87ca-4afbda52653a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "472e91c7-b54d-45df-87ca-4afbda52653a", "address": "fa:16:3e:de:95:4c", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472e91c7-b5", "ovs_interfaceid": "472e91c7-b54d-45df-87ca-4afbda52653a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:95:4c,bridge_name='br-int',has_traffic_filtering=True,id=472e91c7-b54d-45df-87ca-4afbda52653a,network=Network(3f116733-0596-458c-af17-ad1adf342a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472e91c7-b5') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:95:4c,bridge_name='br-int',has_traffic_filtering=True,id=472e91c7-b54d-45df-87ca-4afbda52653a,network=Network(3f116733-0596-458c-af17-ad1adf342a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472e91c7-b5') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap472e91c7-b5, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:95:4c,bridge_name='br-int',has_traffic_filtering=True,id=472e91c7-b54d-45df-87ca-4afbda52653a,network=Network(3f116733-0596-458c-af17-ad1adf342a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472e91c7-b5')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1228215837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1228215837',id=12,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjj471sFmpRy4gg+QldxahRdW1UVKdRuvtnXkWGY55tiOxJtDzXKRgcBWHbFKlQC0RB1M7JPqhXZgEp93l+dGkyoA1IZC2890SPtwWD1Bh3yaTwh2eihPwgc0rlcrXVug==',key_name='tempest-keypair-1794779525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149a7cfea1764821ae439bd5207ecca8',ramdisk_id='',reservation_id='r-9kk84ejk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1416494736',owner_user_name='tempest-TaggedBootDevicesTest-1416494736-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fdbf41ef1d4a01b8121754e0618870',uuid=b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "address": "fa:16:3e:c3:ca:cc", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a63188e-a8", "ovs_interfaceid": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converting VIF {"id": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "address": "fa:16:3e:c3:ca:cc", "network": {"id": "3f116733-0596-458c-af17-ad1adf342a4f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1565898449", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "149a7cfea1764821ae439bd5207ecca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a63188e-a8", "ovs_interfaceid": "1a63188e-a8b1-436a-a767-25ba732d9a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:cc,bridge_name='br-int',has_traffic_filtering=True,id=1a63188e-a8b1-436a-a767-25ba732d9a6f,network=Network(3f116733-0596-458c-af17-ad1adf342a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a63188e-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:cc,bridge_name='br-int',has_traffic_filtering=True,id=1a63188e-a8b1-436a-a767-25ba732d9a6f,network=Network(3f116733-0596-458c-af17-ad1adf342a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a63188e-a8') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a63188e-a8, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[995e20d6-1daa-4f82-b1c0-d1aa48c2182e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: INFO os_vif [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ca:cc,bridge_name='br-int',has_traffic_filtering=True,id=1a63188e-a8b1-436a-a767-25ba732d9a6f,network=Network(3f116733-0596-458c-af17-ad1adf342a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a63188e-a8')
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Unplugged VIFs for instance {{(pid=74820) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b] added
Nov 08 18:31:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No VIF found with MAC fa:16:3e:92:ce:7a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb36f3cb-1a80-40a0-b91d-fa6272d49e81]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[25787ad6-79ba-469c-b936-04a9d0d5f4da]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQlnaZpK {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQlnaZpK" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[92137161-f783-4374-86ca-c09967b34bcc]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQlnaZpK'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[000fd195-1fe1-4621-8fcb-6bd55c69a28b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b274ec-210f-4178-8f78-269cbb58b95d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:00 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:00 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:31:00 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:00 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:00 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:31:00 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3098b1-4213-4965-a065-4021cf27b68f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260]
Nov 08 18:31:00 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260] successful.
Nov 08 18:31:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[699b1de4-885b-48dd-9b37-b4320aec10d2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d457e0-2c9b-4bd9-ba97-9c850246936a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:01 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updated VIF entry in instance network info cache for port 4564ddbd-d3fa-45cc-81a3-76e687daf8b6. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updating instance_info_cache with network_info: [{"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.035s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49561d4-9c71-48e5-9445-13a746c46d8a]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c2467396-53fc-4103-8c46-cf98aa07e9b4 req-52beae2e-5c26-4625-84fa-fcf2053d4c5a service nova] Releasing lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] swap_volume: Updating volume c97896dc-62f2-489c-9a8a-7b83093bd1dc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HvIhlqVj", "auth_password": "M9qQ6VBcf0HbwS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "f3577301-887e-4294-a6fa-000e62e95c85"}, "status": "reserved", "instance": "133d6dc8-9328-4831-a247-d655d91d32a9", "attached_at": "", "detached_at": "", "volume_id": "f3577301-887e-4294-a6fa-000e62e95c85", "serial": "f3577301-887e-4294-a6fa-000e62e95c85"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f3577301-887e-4294-a6fa-000e62e95c85', 'no_device': None, 'attachment_id': '45b07795-58a4-4c9e-b8e0-e596bed79f44'} {{(pid=74820) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43f5b0dc-4370-4425-a816-18e8f4c86d31 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 57.877s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:01 user nova-compute[74820]: INFO nova.compute.manager [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Unshelving
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG nova.objects.instance [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'flavor' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:01 user nova-compute[74820]: INFO nova.virt.block_device [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Booting with volume 85a2198c-8a72-4030-a281-a63d318debce at /dev/vdc
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee792a60-a1e6-4749-a0fc-1cb7ec8e5c1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546ab7d-6372-489c-b53b-023c5b08dc7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c623fa0-c32e-4502-8e05-b15d65df9fa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75b4f8-fd4b-4e44-bc89-66b44ae10394]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:01 user nova-compute[74820]: INFO nova.compute.manager [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Attaching volume b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c to /dev/vdb
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:01 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[047edb61-8b80-4880-aff8-9f8da00fb92f]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating existing volume attachment record: 1d622448-637b-4bd9-be21-d96a0ff08093 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e866d76-ccaf-4fd4-887b-dd6e7563b202]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0a8c0c-527b-438f-bb2e-2ae85b530c88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1a1208-5d7b-4e4c-9d0b-7a50b178fc13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de887e-3899-44cd-ad8c-bf766cf42703]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:01 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:31:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2510c-37ad-43e4-b79e-392e3a2b80b1]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:01 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating existing volume attachment record: 185c7027-f9ac-49a3-8bd5-ab1197344455 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23435656364666433', 'path': '/dev/sdd'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435656364666433', 'path': '/dev/sdd'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281338095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281338095',id=11,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-8sr3ipkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:46Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=c51df6e9-c969-4869-88be-77c877029dde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.objects.instance [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'pci_devices' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:31:02 user nova-compute[74820]:   <uuid>c51df6e9-c969-4869-88be-77c877029dde</uuid>
Nov 08 18:31:02 user nova-compute[74820]:   <name>instance-0000000b</name>
Nov 08 18:31:02 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:31:02 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:31:02 user nova-compute[74820]:   <metadata>
Nov 08 18:31:02 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:02 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:31:02 user nova-compute[74820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1281338095</nova:name>
Nov 08 18:31:02 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:31:00</nova:creationTime>
Nov 08 18:31:02 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:31:02 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:02 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:31:02 user nova-compute[74820]:       <nova:owner>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:user uuid="c5790613f8a24f52897aedd0634f7f7f">tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member</nova:user>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:project uuid="e77a76c049904c6abe35b10929563c00">tempest-ServerBootFromVolumeStableRescueTest-516881030</nova:project>
Nov 08 18:31:02 user nova-compute[74820]:       </nova:owner>
Nov 08 18:31:02 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:02 user nova-compute[74820]:       <nova:ports>
Nov 08 18:31:02 user nova-compute[74820]:         <nova:port uuid="b5562326-c480-40aa-80ab-db849577b104">
Nov 08 18:31:02 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 18:31:02 user nova-compute[74820]:         </nova:port>
Nov 08 18:31:02 user nova-compute[74820]:       </nova:ports>
Nov 08 18:31:02 user nova-compute[74820]:     </nova:instance>
Nov 08 18:31:02 user nova-compute[74820]:   </metadata>
Nov 08 18:31:02 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:31:02 user nova-compute[74820]:     <system>
Nov 08 18:31:02 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:31:02 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:31:02 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:31:02 user nova-compute[74820]:       <entry name="serial">c51df6e9-c969-4869-88be-77c877029dde</entry>
Nov 08 18:31:02 user nova-compute[74820]:       <entry name="uuid">c51df6e9-c969-4869-88be-77c877029dde</entry>
Nov 08 18:31:02 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:31:02 user nova-compute[74820]:     </system>
Nov 08 18:31:02 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:02 user nova-compute[74820]:   <os>
Nov 08 18:31:02 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:31:02 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:31:02 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:31:02 user nova-compute[74820]:   </os>
Nov 08 18:31:02 user nova-compute[74820]:   <features>
Nov 08 18:31:02 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:02 user nova-compute[74820]:     <apic/>
Nov 08 18:31:02 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:31:02 user nova-compute[74820]:   </features>
Nov 08 18:31:02 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:31:02 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:31:02 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:31:02 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:31:02 user nova-compute[74820]:   </clock>
Nov 08 18:31:02 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:31:02 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:31:02 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:31:02 user nova-compute[74820]:   </cpu>
Nov 08 18:31:02 user nova-compute[74820]:   <devices>
Nov 08 18:31:02 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:31:02 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:31:02 user nova-compute[74820]:       <source dev="/dev/sdd"/>
Nov 08 18:31:02 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:31:02 user nova-compute[74820]:       <serial>862b48d8-4df9-4c26-8fa4-e927ecac302b</serial>
Nov 08 18:31:02 user nova-compute[74820]:     </disk>
Nov 08 18:31:02 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:31:02 user nova-compute[74820]:       <mac address="fa:16:3e:62:44:0b"/>
Nov 08 18:31:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:31:02 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:31:02 user nova-compute[74820]:       <target dev="tapb5562326-c4"/>
Nov 08 18:31:02 user nova-compute[74820]:     </interface>
Nov 08 18:31:02 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:31:02 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/console.log" append="off"/>
Nov 08 18:31:02 user nova-compute[74820]:     </serial>
Nov 08 18:31:02 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:31:02 user nova-compute[74820]:     <video>
Nov 08 18:31:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:31:02 user nova-compute[74820]:     </video>
Nov 08 18:31:02 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:31:02 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:31:02 user nova-compute[74820]:     </rng>
Nov 08 18:31:02 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:31:02 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:31:02 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:31:02 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:02 user nova-compute[74820]:   </devices>
Nov 08 18:31:02 user nova-compute[74820]: </domain>
Nov 08 18:31:02 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281338095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281338095',id=11,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-8sr3ipkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:29:46Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=c51df6e9-c969-4869-88be-77c877029dde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG os_vif [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f147903c-b762-5694-a7dd-22f7cc064e10', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5562326-c4, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5562326-c4, col_values=(('qos', UUID('0ec0dda4-4b95-4399-9243-f2a32d3d6e58')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5562326-c4, col_values=(('external_ids', {'iface-id': 'b5562326-c480-40aa-80ab-db849577b104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:44:0b', 'vm-uuid': 'c51df6e9-c969-4869-88be-77c877029dde'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: INFO os_vif [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4')
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No VIF found with MAC fa:16:3e:62:44:0b, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-29f87b90-833e-4d62-9983-3eb4307b0b60 req-f564cea6-b6b1-45e4-a1f0-638c3588a744 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-29f87b90-833e-4d62-9983-3eb4307b0b60 req-f564cea6-b6b1-45e4-a1f0-638c3588a744 service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-29f87b90-833e-4d62-9983-3eb4307b0b60 req-f564cea6-b6b1-45e4-a1f0-638c3588a744 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-29f87b90-833e-4d62-9983-3eb4307b0b60 req-f564cea6-b6b1-45e4-a1f0-638c3588a744 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-29f87b90-833e-4d62-9983-3eb4307b0b60 req-f564cea6-b6b1-45e4-a1f0-638c3588a744 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:02 user nova-compute[74820]: WARNING nova.compute.manager [req-29f87b90-833e-4d62-9983-3eb4307b0b60 req-f564cea6-b6b1-45e4-a1f0-638c3588a744 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state building and task_state spawning.
Nov 08 18:31:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:03 user nova-compute[74820]: INFO nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Took 3.03 seconds to deallocate network for instance.
Nov 08 18:31:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Detaching volume: ecc4f77a-f0cd-4316-95a8-8e7590983a3c {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:31:03 user nova-compute[74820]: INFO nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Detaching volume ecc4f77a-f0cd-4316-95a8-8e7590983a3c
Nov 08 18:31:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-d2ad7c40-8a18-4c5c-a798-d1d239df0780 req-d8f1ba7e-fd01-444e-9c45-ed6408d9df82 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d2ad7c40-8a18-4c5c-a798-d1d239df0780 req-d8f1ba7e-fd01-444e-9c45-ed6408d9df82 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d2ad7c40-8a18-4c5c-a798-d1d239df0780 req-d8f1ba7e-fd01-444e-9c45-ed6408d9df82 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d2ad7c40-8a18-4c5c-a798-d1d239df0780 req-d8f1ba7e-fd01-444e-9c45-ed6408d9df82 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-d2ad7c40-8a18-4c5c-a798-d1d239df0780 req-d8f1ba7e-fd01-444e-9c45-ed6408d9df82 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:03 user nova-compute[74820]: WARNING nova.compute.manager [req-d2ad7c40-8a18-4c5c-a798-d1d239df0780 req-d8f1ba7e-fd01-444e-9c45-ed6408d9df82 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state building and task_state spawning.
Nov 08 18:31:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-d5f0c2f4-4a31-404e-bc46-b0064c43b963 req-84a09934-d028-4c43-a7ec-d58f2ef0ae7f service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d5f0c2f4-4a31-404e-bc46-b0064c43b963 req-84a09934-d028-4c43-a7ec-d58f2ef0ae7f service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d5f0c2f4-4a31-404e-bc46-b0064c43b963 req-84a09934-d028-4c43-a7ec-d58f2ef0ae7f service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d5f0c2f4-4a31-404e-bc46-b0064c43b963 req-84a09934-d028-4c43-a7ec-d58f2ef0ae7f service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-d5f0c2f4-4a31-404e-bc46-b0064c43b963 req-84a09934-d028-4c43-a7ec-d58f2ef0ae7f service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:04 user nova-compute[74820]: WARNING nova.compute.manager [req-d5f0c2f4-4a31-404e-bc46-b0064c43b963 req-84a09934-d028-4c43-a7ec-d58f2ef0ae7f service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state building and task_state spawning.
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:31:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance spawned successfully.
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: INFO nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:31:05 user nova-compute[74820]: INFO nova.compute.manager [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Took 8.29 seconds to build instance.
Nov 08 18:31:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fabf1b46-3077-45cc-8b6d-c3e0dfaa5115 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.614s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:31:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance spawned successfully.
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-bbc2274b-b3a1-4d96-a13f-0ffdf07051a4 req-e4d60f06-9beb-446d-8b58-84b7f1a59d7a service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bbc2274b-b3a1-4d96-a13f-0ffdf07051a4 req-e4d60f06-9beb-446d-8b58-84b7f1a59d7a service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bbc2274b-b3a1-4d96-a13f-0ffdf07051a4 req-e4d60f06-9beb-446d-8b58-84b7f1a59d7a service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bbc2274b-b3a1-4d96-a13f-0ffdf07051a4 req-e4d60f06-9beb-446d-8b58-84b7f1a59d7a service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-bbc2274b-b3a1-4d96-a13f-0ffdf07051a4 req-e4d60f06-9beb-446d-8b58-84b7f1a59d7a service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:05 user nova-compute[74820]: WARNING nova.compute.manager [req-bbc2274b-b3a1-4d96-a13f-0ffdf07051a4 req-e4d60f06-9beb-446d-8b58-84b7f1a59d7a service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state building and task_state spawning.
Nov 08 18:31:06 user nova-compute[74820]: INFO nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 08 18:31:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:31:06 user nova-compute[74820]: INFO nova.compute.manager [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Took 81.01 seconds to build instance.
Nov 08 18:31:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-84d67891-ad4a-4eef-a131-1b93f25484c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "c51df6e9-c969-4869-88be-77c877029dde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 81.118s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:07 user nova-compute[74820]: WARNING nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Failed to detach volume: f871047b-86c5-4899-86ba-56563ce2c5f3 due to 'NoneType' object has no attribute 'devices'
Nov 08 18:31:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Detaching volume: de002da2-5fa4-443f-b1ac-d057e349cfbd {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:31:07 user nova-compute[74820]: INFO nova.compute.manager [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Detaching volume de002da2-5fa4-443f-b1ac-d057e349cfbd
Nov 08 18:31:08 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Skipping driver_detach during remote rebuild. {{(pid=74820) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 18:31:08 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] [instance: 8916abda-c9a1-4dd6-b70d-f94f430a09e9] Skipping driver_detach during remote rebuild. {{(pid=74820) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 18:31:09 user nova-compute[74820]: WARNING nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Failed to detach volume: ecc4f77a-f0cd-4316-95a8-8e7590983a3c due to 'NoneType' object has no attribute 'devices'
Nov 08 18:31:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Detaching volume: 16b300d3-6730-4212-9816-1ab558149fd6 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:31:09 user nova-compute[74820]: INFO nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Detaching volume 16b300d3-6730-4212-9816-1ab558149fd6
Nov 08 18:31:09 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Deleted allocations for instance 8916abda-c9a1-4dd6-b70d-f94f430a09e9
Nov 08 18:31:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4a24a59e-c963-4c29-89c5-6b01aca964b0 tempest-TaggedBootDevicesTest_v242-1376636969 tempest-TaggedBootDevicesTest_v242-1376636969-project-member] Lock "8916abda-c9a1-4dd6-b70d-f94f430a09e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 119.633s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:09 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Skipping driver_detach during remote rebuild. {{(pid=74820) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 18:31:10 user nova-compute[74820]: WARNING nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Failed to detach volume: 16b300d3-6730-4212-9816-1ab558149fd6 due to 'NoneType' object has no attribute 'devices'
Nov 08 18:31:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Detaching volume: 380ade75-788b-4bf9-86b7-3f1ceff4bfc4 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:31:10 user nova-compute[74820]: INFO nova.compute.manager [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Detaching volume 380ade75-788b-4bf9-86b7-3f1ceff4bfc4
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG os_brick.utils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ac378-2ebd-432e-b34c-e9ea35f94d30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] [instance: b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9] Skipping driver_detach during remote rebuild. {{(pid=74820) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80dc73-8429-4fc6-805b-ef953a503407]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca46ba-d6a3-40a7-9afd-9057168c2768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e6098a-a5ec-49a4-a456-76210dd175d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:10 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8233c5c7-772b-4d0a-83b8-1d7bba73ba8c]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:31:10 user nova-compute[74820]: DEBUG os_brick.utils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:10 user nova-compute[74820]: INFO nova.compute.manager [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Swapping volume f3577301-887e-4294-a6fa-000e62e95c85 for c97896dc-62f2-489c-9a8a-7b83093bd1dc
Nov 08 18:31:10 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Deleted allocations for instance b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9
Nov 08 18:31:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d36ca735-84e2-4424-987e-357ec1a61d19 tempest-TaggedBootDevicesTest-1416494736 tempest-TaggedBootDevicesTest-1416494736-project-member] Lock "b1d68e5d-1a17-4fd3-aa2e-f650b55b57a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 68.023s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 is timed out.
Nov 08 18:31:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully detached device vdb from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the live domain config.
Nov 08 18:31:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDpJnjEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:15 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1aa057-75aa-45c1-b0e5-1a66674fa120]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:31:15 user nova-compute[74820]: No targets found.
Nov 08 18:31:15 user nova-compute[74820]: iSNS:
Nov 08 18:31:15 user nova-compute[74820]: No targets found.
Nov 08 18:31:15 user nova-compute[74820]: STATIC:
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: FIRMWARE:
Nov 08 18:31:15 user nova-compute[74820]: No targets found.
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:31:15 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:31:15 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab6c855-fb2c-4f36-9019-90d5cef929a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95404364-e8cb-4225-9b8b-d2a48fae96b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e283f1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944485a-f40e-407d-aa11-ccf7cb55ea46]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7205e1-9dea-4361-bf5c-6ad31c3524f7]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3cb7c-8e08-4a7a-9257-0edf766f4134]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec24e61-c2e8-4137-9e2a-62aba0e1a265]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd1c2d-8313-49a8-9de2-ce99cc5c0000]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85edf0-a3fd-4dae-acdc-27354a050062]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260]
Nov 08 18:31:15 user nova-compute[74820]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f, portal: 172.16.0.220,3260] successful.
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed1c86f-0e07-4d30-a45c-4acb4864949f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a38e9a-0f8e-4987-a9b9-b97481bb037b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] <== disconnect_volume: return (324ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:31:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 is timed out.
Nov 08 18:31:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Successfully detached device vdb from instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 from the live domain config.
Nov 08 18:31:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cAUxpWte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:15 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d5990-e4e8-4a91-9599-7123fa9e6dab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:31:15 user nova-compute[74820]: No targets found.
Nov 08 18:31:15 user nova-compute[74820]: iSNS:
Nov 08 18:31:15 user nova-compute[74820]: No targets found.
Nov 08 18:31:15 user nova-compute[74820]: STATIC:
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79
Nov 08 18:31:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:15 user nova-compute[74820]: FIRMWARE:
Nov 08 18:31:15 user nova-compute[74820]: No targets found.
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:31:15 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:31:15 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16efa5d-bd6d-4699-9790-0ae926e63cc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64106ad4-6c8b-41f9-bda0-46831085179a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:15 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e283f1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16c43b-60bd-4b3a-9fff-65f02a963be5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11300b7-ba65-455d-9343-34d0219efbe2]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9d127-4958-4667-80c2-952395062138]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea8142-1c53-4a51-8259-fa6828cb4cae]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e18feb-9725-4d07-9a64-7a0c16ca0008]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b5d56-4724-4930-888b-079065722114]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260]
Nov 08 18:31:16 user nova-compute[74820]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79, portal: 172.16.0.220,3260] successful.
Nov 08 18:31:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f36f35-b638-48ca-b9b1-ad31b45d5d79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ff1c6-f1ed-477e-b4ce-fffb51de95af]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] <== disconnect_volume: return (326ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:31:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'flavor' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-570d0923-88b9-4a56-b17b-8501c6a378b6 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.330s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:28 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:28 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:28 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af538d99-efc4-4932-8e6a-0382f406632b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:31:28 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98aef67-8c8b-4dc2-ad65-f4bc90c7806f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c] added
Nov 08 18:31:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a18f3-496c-4476-8ea3-884c87dc8c12]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118528e-fc32-49f7-aeff-15affe1db896]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArcIaCeV {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArcIaCeV" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c5b93-cbb7-4e69-bfd2-d1dc35578336]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ArcIaCeV'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9f2a8-ad3b-4f91-8690-4149b8b2029f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'pci_requests' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c776bae0-a3e0-4471-8670-169231f8e56c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:31:28 user nova-compute[74820]: INFO nova.compute.claims [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Claim successful on node user
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55fbd13-4112-423a-b534-423ce33d2dda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]
Nov 08 18:31:28 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.
Nov 08 18:31:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd75c88-1316-433d-8af8-71768367d09a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c7e8d-8e56-4579-8768-bbe5e1d4e1b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:31:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:28 user nova-compute[74820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:31:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ef036-8b9c-45d7-8382-b3308b421cf1]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "interface-a2eddce3-e832-4737-be16-6d6a6ba7dc77-0b9dc916-5c77-4494-8657-79f2b7b6ab69" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "interface-a2eddce3-e832-4737-be16-6d6a6ba7dc77-0b9dc916-5c77-4494-8657-79f2b7b6ab69" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'flavor' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface> {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface> {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Attempting to detach device tap0b9dc916-5c from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] detach device xml: <interface type="ethernet">
Nov 08 18:31:28 user nova-compute[74820]:   <mac address="fa:16:3e:6c:ab:10"/>
Nov 08 18:31:28 user nova-compute[74820]:   <model type="virtio"/>
Nov 08 18:31:28 user nova-compute[74820]:   <mtu size="1442"/>
Nov 08 18:31:28 user nova-compute[74820]:   <target dev="tap0b9dc916-5c"/>
Nov 08 18:31:28 user nova-compute[74820]: </interface>
Nov 08 18:31:28 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface> {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 18:31:28 user nova-compute[74820]:   <name>instance-00000007</name>
Nov 08 18:31:28 user nova-compute[74820]:   <uuid>a2eddce3-e832-4737-be16-6d6a6ba7dc77</uuid>
Nov 08 18:31:28 user nova-compute[74820]:   <metadata>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:28 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:31:28 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:31:28 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:29:19</nova:creationTime>
Nov 08 18:31:28 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:31:28 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:28 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:31:28 user nova-compute[74820]:   <nova:owner>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:31:28 user nova-compute[74820]:   </nova:owner>
Nov 08 18:31:28 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:28 user nova-compute[74820]:   <nova:ports>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:31:28 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:31:28 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:28 user nova-compute[74820]:     <nova:port uuid="0b9dc916-5c77-4494-8657-79f2b7b6ab69">
Nov 08 18:31:28 user nova-compute[74820]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Nov 08 18:31:28 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:28 user nova-compute[74820]:   </nova:ports>
Nov 08 18:31:28 user nova-compute[74820]: </nova:instance>
Nov 08 18:31:28 user nova-compute[74820]:   </metadata>
Nov 08 18:31:28 user nova-compute[74820]:   <memory unit='KiB'>524288</memory>
Nov 08 18:31:28 user nova-compute[74820]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 18:31:28 user nova-compute[74820]:   <vcpu placement='static'>1</vcpu>
Nov 08 18:31:28 user nova-compute[74820]:   <resource>
Nov 08 18:31:28 user nova-compute[74820]:     <partition>/machine</partition>
Nov 08 18:31:28 user nova-compute[74820]:   </resource>
Nov 08 18:31:28 user nova-compute[74820]:   <sysinfo type='smbios'>
Nov 08 18:31:28 user nova-compute[74820]:     <system>
Nov 08 18:31:28 user nova-compute[74820]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 18:31:28 user nova-compute[74820]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 18:31:28 user nova-compute[74820]:       <entry name='version'>0.0.0</entry>
Nov 08 18:31:28 user nova-compute[74820]:       <entry name='serial'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:28 user nova-compute[74820]:       <entry name='uuid'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:28 user nova-compute[74820]:       <entry name='family'>Virtual Machine</entry>
Nov 08 18:31:28 user nova-compute[74820]:     </system>
Nov 08 18:31:28 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:28 user nova-compute[74820]:   <os>
Nov 08 18:31:28 user nova-compute[74820]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 18:31:28 user nova-compute[74820]:     <boot dev='hd'/>
Nov 08 18:31:28 user nova-compute[74820]:     <smbios mode='sysinfo'/>
Nov 08 18:31:28 user nova-compute[74820]:   </os>
Nov 08 18:31:28 user nova-compute[74820]:   <features>
Nov 08 18:31:28 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:28 user nova-compute[74820]:     <apic/>
Nov 08 18:31:28 user nova-compute[74820]:     <vmcoreinfo state='on'/>
Nov 08 18:31:28 user nova-compute[74820]:   </features>
Nov 08 18:31:28 user nova-compute[74820]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 18:31:28 user nova-compute[74820]:     <model fallback='forbid'>Nehalem</model>
Nov 08 18:31:28 user nova-compute[74820]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 18:31:28 user nova-compute[74820]:     <feature policy='require' name='vme'/>
Nov 08 18:31:28 user nova-compute[74820]:     <feature policy='require' name='x2apic'/>
Nov 08 18:31:28 user nova-compute[74820]:     <feature policy='require' name='hypervisor'/>
Nov 08 18:31:28 user nova-compute[74820]:   </cpu>
Nov 08 18:31:28 user nova-compute[74820]:   <clock offset='utc'>
Nov 08 18:31:28 user nova-compute[74820]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 18:31:28 user nova-compute[74820]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 18:31:28 user nova-compute[74820]:     <timer name='hpet' present='no'/>
Nov 08 18:31:28 user nova-compute[74820]:   </clock>
Nov 08 18:31:28 user nova-compute[74820]:   <on_poweroff>destroy</on_poweroff>
Nov 08 18:31:28 user nova-compute[74820]:   <on_reboot>restart</on_reboot>
Nov 08 18:31:28 user nova-compute[74820]:   <on_crash>destroy</on_crash>
Nov 08 18:31:28 user nova-compute[74820]:   <devices>
Nov 08 18:31:28 user nova-compute[74820]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 18:31:28 user nova-compute[74820]:     <disk type='file' device='disk'>
Nov 08 18:31:28 user nova-compute[74820]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 18:31:28 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk' index='2'/>
Nov 08 18:31:28 user nova-compute[74820]:       <backingStore type='file' index='3'>
Nov 08 18:31:28 user nova-compute[74820]:         <format type='raw'/>
Nov 08 18:31:28 user nova-compute[74820]:         <source file='/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf'/>
Nov 08 18:31:28 user nova-compute[74820]:         <backingStore/>
Nov 08 18:31:28 user nova-compute[74820]:       </backingStore>
Nov 08 18:31:28 user nova-compute[74820]:       <target dev='vda' bus='virtio'/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='virtio-disk0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </disk>
Nov 08 18:31:28 user nova-compute[74820]:     <disk type='file' device='cdrom'>
Nov 08 18:31:28 user nova-compute[74820]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 18:31:28 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config' index='1'/>
Nov 08 18:31:28 user nova-compute[74820]:       <backingStore/>
Nov 08 18:31:28 user nova-compute[74820]:       <target dev='hda' bus='ide'/>
Nov 08 18:31:28 user nova-compute[74820]:       <readonly/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='ide0-0-0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </disk>
Nov 08 18:31:28 user nova-compute[74820]:     <controller type='usb' index='0' model='none'>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='usb'/>
Nov 08 18:31:28 user nova-compute[74820]:     </controller>
Nov 08 18:31:28 user nova-compute[74820]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='pci.0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </controller>
Nov 08 18:31:28 user nova-compute[74820]:     <controller type='ide' index='0'>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='ide'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 18:31:28 user nova-compute[74820]:     </controller>
Nov 08 18:31:28 user nova-compute[74820]:     <interface type='ethernet'>
Nov 08 18:31:28 user nova-compute[74820]:       <mac address='fa:16:3e:f5:43:e0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <target dev='tap7c540edf-72'/>
Nov 08 18:31:28 user nova-compute[74820]:       <model type='virtio'/>
Nov 08 18:31:28 user nova-compute[74820]:       <mtu size='1442'/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='net0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </interface>
Nov 08 18:31:28 user nova-compute[74820]:     <interface type='ethernet'>
Nov 08 18:31:28 user nova-compute[74820]:       <mac address='fa:16:3e:6c:ab:10'/>
Nov 08 18:31:28 user nova-compute[74820]:       <target dev='tap0b9dc916-5c'/>
Nov 08 18:31:28 user nova-compute[74820]:       <model type='virtio'/>
Nov 08 18:31:28 user nova-compute[74820]:       <mtu size='1442'/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='net1'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </interface>
Nov 08 18:31:28 user nova-compute[74820]:     <serial type='pty'>
Nov 08 18:31:28 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:28 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:28 user nova-compute[74820]:       <target type='isa-serial' port='0'>
Nov 08 18:31:28 user nova-compute[74820]:         <model name='isa-serial'/>
Nov 08 18:31:28 user nova-compute[74820]:       </target>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </serial>
Nov 08 18:31:28 user nova-compute[74820]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 18:31:28 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:28 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:28 user nova-compute[74820]:       <target type='serial' port='0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </console>
Nov 08 18:31:28 user nova-compute[74820]:     <input type='mouse' bus='ps2'>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='input0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </input>
Nov 08 18:31:28 user nova-compute[74820]:     <input type='keyboard' bus='ps2'>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='input1'/>
Nov 08 18:31:28 user nova-compute[74820]:     </input>
Nov 08 18:31:28 user nova-compute[74820]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 18:31:28 user nova-compute[74820]:       <listen type='address' address='0.0.0.0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </graphics>
Nov 08 18:31:28 user nova-compute[74820]:     <audio id='1' type='none'/>
Nov 08 18:31:28 user nova-compute[74820]:     <video>
Nov 08 18:31:28 user nova-compute[74820]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='video0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </video>
Nov 08 18:31:28 user nova-compute[74820]:     <memballoon model='virtio'>
Nov 08 18:31:28 user nova-compute[74820]:       <stats period='10'/>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='balloon0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:28 user nova-compute[74820]:     <rng model='virtio'>
Nov 08 18:31:28 user nova-compute[74820]:       <backend model='random'>/dev/urandom</backend>
Nov 08 18:31:28 user nova-compute[74820]:       <alias name='rng0'/>
Nov 08 18:31:28 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 18:31:28 user nova-compute[74820]:     </rng>
Nov 08 18:31:28 user nova-compute[74820]:   </devices>
Nov 08 18:31:28 user nova-compute[74820]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 18:31:28 user nova-compute[74820]:     <label>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</label>
Nov 08 18:31:28 user nova-compute[74820]:     <imagelabel>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</imagelabel>
Nov 08 18:31:28 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:28 user nova-compute[74820]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 18:31:28 user nova-compute[74820]:     <label>+64055:+108</label>
Nov 08 18:31:28 user nova-compute[74820]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 18:31:28 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:28 user nova-compute[74820]: </domain>
Nov 08 18:31:28 user nova-compute[74820]:  {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 18:31:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully detached device tap0b9dc916-5c from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the persistent domain config.
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] (1/8): Attempting to detach device tap0b9dc916-5c with device alias net1 from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] detach device xml: <interface type="ethernet">
Nov 08 18:31:28 user nova-compute[74820]:   <mac address="fa:16:3e:6c:ab:10"/>
Nov 08 18:31:28 user nova-compute[74820]:   <model type="virtio"/>
Nov 08 18:31:28 user nova-compute[74820]:   <mtu size="1442"/>
Nov 08 18:31:28 user nova-compute[74820]:   <target dev="tap0b9dc916-5c"/>
Nov 08 18:31:28 user nova-compute[74820]: </interface>
Nov 08 18:31:28 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Start waiting for the detach event from libvirt for device tap0b9dc916-5c with device alias net1 for instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lazy-loading 'flavor' on Instance uuid c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:29 user nova-compute[74820]: INFO nova.network.neutron [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating port 0a750543-2d73-441e-82df-c608edcbea0a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c917cd48-102a-4698-8e42-f2d35767fb37 tempest-VolumesAssistedSnapshotsTest-525855458 tempest-VolumesAssistedSnapshotsTest-525855458-project-admin] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.183s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-0516b38b-9c46-4e1f-800f-51cccf8e0c3a req-5af0f106-3dce-461e-acf0-e6589a99d299 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-unplugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0516b38b-9c46-4e1f-800f-51cccf8e0c3a req-5af0f106-3dce-461e-acf0-e6589a99d299 service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0516b38b-9c46-4e1f-800f-51cccf8e0c3a req-5af0f106-3dce-461e-acf0-e6589a99d299 service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0516b38b-9c46-4e1f-800f-51cccf8e0c3a req-5af0f106-3dce-461e-acf0-e6589a99d299 service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-0516b38b-9c46-4e1f-800f-51cccf8e0c3a req-5af0f106-3dce-461e-acf0-e6589a99d299 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-unplugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:29 user nova-compute[74820]: WARNING nova.compute.manager [req-0516b38b-9c46-4e1f-800f-51cccf8e0c3a req-5af0f106-3dce-461e-acf0-e6589a99d299 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-unplugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 for instance with vm_state active and task_state None.
Nov 08 18:31:29 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26366333637613330', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366333637613330', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.objects.instance [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'flavor' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:31:29 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:31:29 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:31:29 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:31:29 user nova-compute[74820]:   <serial>b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c</serial>
Nov 08 18:31:29 user nova-compute[74820]: </disk>
Nov 08 18:31:29 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.network.neutron [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-changed-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing instance network info cache due to event network-changed-0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:31:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] Acquiring lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No VIF found with MAC fa:16:3e:33:c7:d1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-30663e0d-6c69-4f57-987a-dc5a576abd73 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.451s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:31:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Creating image(s)
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] Acquired lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.network.neutron [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Refreshing network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG nova.objects.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<1f6a8436-ae6e-4edb-8046-baccf72c6560> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-5f633df7-bd64-4199-babe-5edb0858d883 req-d9a1a155-8150-48b4-8c2b-3477eea43bdc service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5f633df7-bd64-4199-babe-5edb0858d883 req-d9a1a155-8150-48b4-8c2b-3477eea43bdc service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5f633df7-bd64-4199-babe-5edb0858d883 req-d9a1a155-8150-48b4-8c2b-3477eea43bdc service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5f633df7-bd64-4199-babe-5edb0858d883 req-d9a1a155-8150-48b4-8c2b-3477eea43bdc service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-5f633df7-bd64-4199-babe-5edb0858d883 req-d9a1a155-8150-48b4-8c2b-3477eea43bdc service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:32 user nova-compute[74820]: WARNING nova.compute.manager [req-5f633df7-bd64-4199-babe-5edb0858d883 req-d9a1a155-8150-48b4-8c2b-3477eea43bdc service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-plugged-0b9dc916-5c77-4494-8657-79f2b7b6ab69 for instance with vm_state active and task_state None.
Nov 08 18:31:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.part --force-share --output=json" returned: 0 in 0.226s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG nova.virt.images [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] a45257d5-6f91-4054-a63f-5a094eb28582 was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.part /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.part /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.converted" returned: 0 in 0.286s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Stashing vm_state: active {{(pid=74820) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.891s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.network.neutron [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updated VIF entry in instance network info cache for port 0a750543-2d73-441e-82df-c608edcbea0a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.network.neutron [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:31:33 user nova-compute[74820]: INFO nova.compute.claims [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Claim successful on node user
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84187485-78b9-41ea-99bb-e531bc6439a2 req-ef1ca960-476b-4127-83da-3815260dc538 service nova] Releasing lock "refresh_cache-1f6a8436-ae6e-4edb-8046-baccf72c6560" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:33 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating resource usage from migration 565bebcc-f827-4164-8740-aaa9834ba06e
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 --force-share --output=json" returned: 0 in 0.263s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1,backing_fmt=raw /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1,backing_fmt=raw /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk 1073741824" returned: 0 in 0.049s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 --force-share --output=json" returned: 0 in 0.207s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'migration_context' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.639s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:33 user nova-compute[74820]: INFO nova.compute.manager [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Migrating
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.objects.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<1f6a8436-ae6e-4edb-8046-baccf72c6560> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:31:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Rebasing disk image.
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:33 user nova-compute[74820]: INFO nova.compute.rpcapi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf -F raw /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:34 user nova-compute[74820]: DEBUG nova.network.neutron [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Starting migrate_disk_and_power_off {{(pid=74820) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-0b44b84a-b1bc-447c-882f-9f654ff97301 req-5b459043-7d46-4ba5-ac62-942b079091fd service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0b44b84a-b1bc-447c-882f-9f654ff97301 req-5b459043-7d46-4ba5-ac62-942b079091fd service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0b44b84a-b1bc-447c-882f-9f654ff97301 req-5b459043-7d46-4ba5-ac62-942b079091fd service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0b44b84a-b1bc-447c-882f-9f654ff97301 req-5b459043-7d46-4ba5-ac62-942b079091fd service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-0b44b84a-b1bc-447c-882f-9f654ff97301 req-5b459043-7d46-4ba5-ac62-942b079091fd service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:35 user nova-compute[74820]: WARNING nova.compute.manager [req-0b44b84a-b1bc-447c-882f-9f654ff97301 req-5b459043-7d46-4ba5-ac62-942b079091fd service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state resize_migrating.
Nov 08 18:31:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance destroyed successfully.
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85125f2a-e0, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22677baa-ce17-4283-aeab-35050a59333c) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:36 user nova-compute[74820]: INFO os_vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0')
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:36 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22044bb-5c23-4915-99af-cb3fc19ec99a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:31:36 user nova-compute[74820]: No targets found.
Nov 08 18:31:36 user nova-compute[74820]: iSNS:
Nov 08 18:31:36 user nova-compute[74820]: No targets found.
Nov 08 18:31:36 user nova-compute[74820]: STATIC:
Nov 08 18:31:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:31:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:31:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:31:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85
Nov 08 18:31:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:31:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:31:36 user nova-compute[74820]: FIRMWARE:
Nov 08 18:31:36 user nova-compute[74820]: No targets found.
Nov 08 18:31:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:31:36 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:31:36 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5dc1f6-a630-46e2-8c50-f3aab6d63e9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155d4ad-1b95-451c-a37d-36d8428e60d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:36 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:36 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:36 user nova-compute[74820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:31:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:36 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:36 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:36 user nova-compute[74820]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:31:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e281fc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2f106-2165-49d0-b5bc-4d6c63501a78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[acada070-6511-4ee6-9ee2-c222efc42afe]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c3723f-7fff-4ed8-b78b-37b023814640]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf -F raw /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk" returned: 0 in 2.932s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Ensure instance console log exists: /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Start _get_guest_xml network_info=[{"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1e03beda7f9d74a986785f98513b961f',container_format='bare',created_at=2023-11-08T18:28:56Z,direct_url=<?>,disk_format='qcow2',id=a45257d5-6f91-4054-a63f-5a094eb28582,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2024314283-shelved',owner='80c3b99ebc044d32a5647dc7963f11ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T18:29:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '1d622448-637b-4bd9-be21-d96a0ff08093', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCwXcdiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1f6a8436-ae6e-4edb-8046-baccf72c6560', 'attached_at': '', 'detached_at': '', 'volume_id': '85a2198c-8a72-4030-a281-a63d318debce', 'serial': '85a2198c-8a72-4030-a281-a63d318debce'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:31:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.103s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[955515a9-d8b3-404a-b254-e2cdade0869a]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1e03beda7f9d74a986785f98513b961f',container_format='bare',created_at=2023-11-08T18:28:56Z,direct_url=<?>,disk_format='qcow2',id=a45257d5-6f91-4054-a63f-5a094eb28582,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2024314283-shelved',owner='80c3b99ebc044d32a5647dc7963f11ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T18:29:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.objects.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<1f6a8436-ae6e-4edb-8046-baccf72c6560> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCwXcdiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:36 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f2a62-5c4c-4976-b8ec-420755006c36]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f15888-7138-461d-8d1d-a8c1a0825bbc]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]
Nov 08 18:31:36 user nova-compute[74820]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.
Nov 08 18:31:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f125ca06-3185-485b-bb8c-93b1277a9c5a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.521s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== disconnect_volume: return (524ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.128s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:36 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:31:36 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[37deab69-9547-42f8-a246-edbef0613828]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:31:37 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb609c46-73b2-4e57-93f9-b88c41e52d29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce] added
Nov 08 18:31:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4484f79-6372-434d-930d-1208d5d29343]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca78f16-2893-4103-a739-bf927adb9ecf]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCwXcdiQ {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCwXcdiQ" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc87ace-cbf6-492e-b411-2482c7c8681c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YCwXcdiQ'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac875e62-f611-4f2c-ab83-858ecf6a81b0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f77420-7c8a-47ac-881f-c276744cbda8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2139b3-e6ca-4331-85af-965115d1bf90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260]
Nov 08 18:31:37 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260] successful.
Nov 08 18:31:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30957d6c-d0fd-4f56-912e-68ab1551fde6]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f099c5-f50b-4fb7-8c87-0430e67d9fee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:31:37 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:31:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6cbe7-5df8-4331-b77a-b14300f7abdc]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCwXcdiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b_resize/disk /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-81b907f2-48c2-49fe-ab22-25fe37fa04d0 req-58392541-b2c6-4179-ae1d-d782c5ad9541 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-81b907f2-48c2-49fe-ab22-25fe37fa04d0 req-58392541-b2c6-4179-ae1d-d782c5ad9541 service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-81b907f2-48c2-49fe-ab22-25fe37fa04d0 req-58392541-b2c6-4179-ae1d-d782c5ad9541 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-81b907f2-48c2-49fe-ab22-25fe37fa04d0 req-58392541-b2c6-4179-ae1d-d782c5ad9541 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-81b907f2-48c2-49fe-ab22-25fe37fa04d0 req-58392541-b2c6-4179-ae1d-d782c5ad9541 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:37 user nova-compute[74820]: WARNING nova.compute.manager [req-81b907f2-48c2-49fe-ab22-25fe37fa04d0 req-58392541-b2c6-4179-ae1d-d782c5ad9541 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state resize_migrating.
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "cp -r /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b_resize/disk /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk" returned: 0 in 0.326s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b_resize/disk.info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk.info {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "cp -r /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b_resize/disk.info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk.info" returned: 0 in 0.048s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '23430343633363561', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430343633363561', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2024314283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2024314283',id=3,image_ref='a45257d5-6f91-4054-a63f-5a094eb28582',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1409935399',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-kk2xmpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member',shelved_at='2023-11-08T18:29:01.425741',shelved_host='user',shelved_image_id='a45257d5-6f91-4054-a63f-5a094eb28582'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=1f6a8436-ae6e-4edb-8046-baccf72c6560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<1f6a8436-ae6e-4edb-8046-baccf72c6560> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:31:38 user nova-compute[74820]:   <uuid>1f6a8436-ae6e-4edb-8046-baccf72c6560</uuid>
Nov 08 18:31:38 user nova-compute[74820]:   <name>instance-00000003</name>
Nov 08 18:31:38 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:31:38 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:31:38 user nova-compute[74820]:   <metadata>
Nov 08 18:31:38 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:38 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:31:38 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2024314283</nova:name>
Nov 08 18:31:38 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:31:36</nova:creationTime>
Nov 08 18:31:38 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:31:38 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:38 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:31:38 user nova-compute[74820]:       <nova:owner>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:user uuid="6adeab5384fc4d8fad36575d715cf133">tempest-AttachVolumeShelveTestJSON-1684933452-project-member</nova:user>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:project uuid="80c3b99ebc044d32a5647dc7963f11ae">tempest-AttachVolumeShelveTestJSON-1684933452</nova:project>
Nov 08 18:31:38 user nova-compute[74820]:       </nova:owner>
Nov 08 18:31:38 user nova-compute[74820]:       <nova:root type="image" uuid="a45257d5-6f91-4054-a63f-5a094eb28582"/>
Nov 08 18:31:38 user nova-compute[74820]:       <nova:ports>
Nov 08 18:31:38 user nova-compute[74820]:         <nova:port uuid="0a750543-2d73-441e-82df-c608edcbea0a">
Nov 08 18:31:38 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 18:31:38 user nova-compute[74820]:         </nova:port>
Nov 08 18:31:38 user nova-compute[74820]:       </nova:ports>
Nov 08 18:31:38 user nova-compute[74820]:     </nova:instance>
Nov 08 18:31:38 user nova-compute[74820]:   </metadata>
Nov 08 18:31:38 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:31:38 user nova-compute[74820]:     <system>
Nov 08 18:31:38 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:31:38 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:31:38 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:31:38 user nova-compute[74820]:       <entry name="serial">1f6a8436-ae6e-4edb-8046-baccf72c6560</entry>
Nov 08 18:31:38 user nova-compute[74820]:       <entry name="uuid">1f6a8436-ae6e-4edb-8046-baccf72c6560</entry>
Nov 08 18:31:38 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:31:38 user nova-compute[74820]:     </system>
Nov 08 18:31:38 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:38 user nova-compute[74820]:   <os>
Nov 08 18:31:38 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:31:38 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:31:38 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:31:38 user nova-compute[74820]:   </os>
Nov 08 18:31:38 user nova-compute[74820]:   <features>
Nov 08 18:31:38 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:38 user nova-compute[74820]:     <apic/>
Nov 08 18:31:38 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:31:38 user nova-compute[74820]:   </features>
Nov 08 18:31:38 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:31:38 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:31:38 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:31:38 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:31:38 user nova-compute[74820]:   </clock>
Nov 08 18:31:38 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:31:38 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:31:38 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:31:38 user nova-compute[74820]:   </cpu>
Nov 08 18:31:38 user nova-compute[74820]:   <devices>
Nov 08 18:31:38 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:31:38 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:31:38 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk"/>
Nov 08 18:31:38 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:31:38 user nova-compute[74820]:     </disk>
Nov 08 18:31:38 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:31:38 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:31:38 user nova-compute[74820]:       <source dev="/dev/sdc"/>
Nov 08 18:31:38 user nova-compute[74820]:       <target dev="vdc" bus="virtio"/>
Nov 08 18:31:38 user nova-compute[74820]:       <serial>85a2198c-8a72-4030-a281-a63d318debce</serial>
Nov 08 18:31:38 user nova-compute[74820]:     </disk>
Nov 08 18:31:38 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:31:38 user nova-compute[74820]:       <mac address="fa:16:3e:b7:83:e9"/>
Nov 08 18:31:38 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:31:38 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:31:38 user nova-compute[74820]:       <target dev="tap0a750543-2d"/>
Nov 08 18:31:38 user nova-compute[74820]:     </interface>
Nov 08 18:31:38 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:31:38 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/console.log" append="off"/>
Nov 08 18:31:38 user nova-compute[74820]:     </serial>
Nov 08 18:31:38 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:31:38 user nova-compute[74820]:     <video>
Nov 08 18:31:38 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:31:38 user nova-compute[74820]:     </video>
Nov 08 18:31:38 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:31:38 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:31:38 user nova-compute[74820]:     </rng>
Nov 08 18:31:38 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:31:38 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:31:38 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:31:38 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:38 user nova-compute[74820]:   </devices>
Nov 08 18:31:38 user nova-compute[74820]: </domain>
Nov 08 18:31:38 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2024314283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2024314283',id=3,image_ref='a45257d5-6f91-4054-a63f-5a094eb28582',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1409935399',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-kk2xmpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member',shelved_at='2023-11-08T18:29:01.425741',shelved_host='user',shelved_image_id='a45257d5-6f91-4054-a63f-5a094eb28582'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=1f6a8436-ae6e-4edb-8046-baccf72c6560,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG os_vif [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ebb04ad-38b6-513f-aa18-a1c889ba26d9', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a750543-2d, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a750543-2d, col_values=(('qos', UUID('3482decf-8115-446f-89df-2c14cbdc9896')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a750543-2d, col_values=(('external_ids', {'iface-id': '0a750543-2d73-441e-82df-c608edcbea0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:83:e9', 'vm-uuid': '1f6a8436-ae6e-4edb-8046-baccf72c6560'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:38 user nova-compute[74820]: INFO os_vif [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d')
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:31:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No VIF found with MAC fa:16:3e:b7:83:e9, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG nova.network.neutron [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Port 85125f2a-e0c8-4893-8e27-7036ee1bb847 binding to destination host user is already ACTIVE {{(pid=74820) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:39 user nova-compute[74820]: DEBUG nova.network.neutron [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG nova.network.neutron [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG os_brick.utils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7270da48-a8dc-4ecf-ae2a-2af95e058561]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0814260e-1a88-4f5c-ad36-7036a2d6ce42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b91e30-9263-4d68-80fd-8568924dddb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30ba848-473f-4363-b8be-cda49c780934]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:31:40 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4880952-2ac8-44d1-a741-136b32b1f300]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG os_brick.utils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-8484ba5b-cbce-49ac-a9c1-e972c1399413 req-4af29dbe-f4d2-474a-8aa1-2573e6301b51 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8484ba5b-cbce-49ac-a9c1-e972c1399413 req-4af29dbe-f4d2-474a-8aa1-2573e6301b51 service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8484ba5b-cbce-49ac-a9c1-e972c1399413 req-4af29dbe-f4d2-474a-8aa1-2573e6301b51 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8484ba5b-cbce-49ac-a9c1-e972c1399413 req-4af29dbe-f4d2-474a-8aa1-2573e6301b51 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-8484ba5b-cbce-49ac-a9c1-e972c1399413 req-4af29dbe-f4d2-474a-8aa1-2573e6301b51 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:42 user nova-compute[74820]: WARNING nova.compute.manager [req-8484ba5b-cbce-49ac-a9c1-e972c1399413 req-4af29dbe-f4d2-474a-8aa1-2573e6301b51 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 18:31:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:31:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance spawned successfully.
Nov 08 18:31:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:31:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3663e457-6088-474b-984e-2837426663fc tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 41.599s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-914f5c1d-2b2a-468f-8221-176f8d4f3165 req-0187dec3-a4ea-4241-be9c-4a78be5140d8 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-914f5c1d-2b2a-468f-8221-176f8d4f3165 req-0187dec3-a4ea-4241-be9c-4a78be5140d8 service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-914f5c1d-2b2a-468f-8221-176f8d4f3165 req-0187dec3-a4ea-4241-be9c-4a78be5140d8 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-914f5c1d-2b2a-468f-8221-176f8d4f3165 req-0187dec3-a4ea-4241-be9c-4a78be5140d8 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-914f5c1d-2b2a-468f-8221-176f8d4f3165 req-0187dec3-a4ea-4241-be9c-4a78be5140d8 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:44 user nova-compute[74820]: WARNING nova.compute.manager [req-914f5c1d-2b2a-468f-8221-176f8d4f3165 req-0187dec3-a4ea-4241-be9c-4a78be5140d8 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state active and task_state None.
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:31:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:31:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Waiting for libvirt event about the detach of device tap0b9dc916-5c with device alias net1 from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 is timed out.
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface> {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 18:31:49 user nova-compute[74820]:   <name>instance-00000007</name>
Nov 08 18:31:49 user nova-compute[74820]:   <uuid>a2eddce3-e832-4737-be16-6d6a6ba7dc77</uuid>
Nov 08 18:31:49 user nova-compute[74820]:   <metadata>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:49 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:29:19</nova:creationTime>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:31:49 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:49 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:owner>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:31:49 user nova-compute[74820]:   </nova:owner>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:ports>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:31:49 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:31:49 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:port uuid="0b9dc916-5c77-4494-8657-79f2b7b6ab69">
Nov 08 18:31:49 user nova-compute[74820]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Nov 08 18:31:49 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:49 user nova-compute[74820]:   </nova:ports>
Nov 08 18:31:49 user nova-compute[74820]: </nova:instance>
Nov 08 18:31:49 user nova-compute[74820]:   </metadata>
Nov 08 18:31:49 user nova-compute[74820]:   <memory unit='KiB'>524288</memory>
Nov 08 18:31:49 user nova-compute[74820]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 18:31:49 user nova-compute[74820]:   <vcpu placement='static'>1</vcpu>
Nov 08 18:31:49 user nova-compute[74820]:   <resource>
Nov 08 18:31:49 user nova-compute[74820]:     <partition>/machine</partition>
Nov 08 18:31:49 user nova-compute[74820]:   </resource>
Nov 08 18:31:49 user nova-compute[74820]:   <sysinfo type='smbios'>
Nov 08 18:31:49 user nova-compute[74820]:     <system>
Nov 08 18:31:49 user nova-compute[74820]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 18:31:49 user nova-compute[74820]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 18:31:49 user nova-compute[74820]:       <entry name='version'>0.0.0</entry>
Nov 08 18:31:49 user nova-compute[74820]:       <entry name='serial'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:49 user nova-compute[74820]:       <entry name='uuid'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:49 user nova-compute[74820]:       <entry name='family'>Virtual Machine</entry>
Nov 08 18:31:49 user nova-compute[74820]:     </system>
Nov 08 18:31:49 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:49 user nova-compute[74820]:   <os>
Nov 08 18:31:49 user nova-compute[74820]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 18:31:49 user nova-compute[74820]:     <boot dev='hd'/>
Nov 08 18:31:49 user nova-compute[74820]:     <smbios mode='sysinfo'/>
Nov 08 18:31:49 user nova-compute[74820]:   </os>
Nov 08 18:31:49 user nova-compute[74820]:   <features>
Nov 08 18:31:49 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:49 user nova-compute[74820]:     <apic/>
Nov 08 18:31:49 user nova-compute[74820]:     <vmcoreinfo state='on'/>
Nov 08 18:31:49 user nova-compute[74820]:   </features>
Nov 08 18:31:49 user nova-compute[74820]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 18:31:49 user nova-compute[74820]:     <model fallback='forbid'>Nehalem</model>
Nov 08 18:31:49 user nova-compute[74820]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 18:31:49 user nova-compute[74820]:     <feature policy='require' name='vme'/>
Nov 08 18:31:49 user nova-compute[74820]:     <feature policy='require' name='x2apic'/>
Nov 08 18:31:49 user nova-compute[74820]:     <feature policy='require' name='hypervisor'/>
Nov 08 18:31:49 user nova-compute[74820]:   </cpu>
Nov 08 18:31:49 user nova-compute[74820]:   <clock offset='utc'>
Nov 08 18:31:49 user nova-compute[74820]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 18:31:49 user nova-compute[74820]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 18:31:49 user nova-compute[74820]:     <timer name='hpet' present='no'/>
Nov 08 18:31:49 user nova-compute[74820]:   </clock>
Nov 08 18:31:49 user nova-compute[74820]:   <on_poweroff>destroy</on_poweroff>
Nov 08 18:31:49 user nova-compute[74820]:   <on_reboot>restart</on_reboot>
Nov 08 18:31:49 user nova-compute[74820]:   <on_crash>destroy</on_crash>
Nov 08 18:31:49 user nova-compute[74820]:   <devices>
Nov 08 18:31:49 user nova-compute[74820]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 18:31:49 user nova-compute[74820]:     <disk type='file' device='disk'>
Nov 08 18:31:49 user nova-compute[74820]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 18:31:49 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk' index='2'/>
Nov 08 18:31:49 user nova-compute[74820]:       <backingStore type='file' index='3'>
Nov 08 18:31:49 user nova-compute[74820]:         <format type='raw'/>
Nov 08 18:31:49 user nova-compute[74820]:         <source file='/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf'/>
Nov 08 18:31:49 user nova-compute[74820]:         <backingStore/>
Nov 08 18:31:49 user nova-compute[74820]:       </backingStore>
Nov 08 18:31:49 user nova-compute[74820]:       <target dev='vda' bus='virtio'/>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='virtio-disk0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </disk>
Nov 08 18:31:49 user nova-compute[74820]:     <disk type='file' device='cdrom'>
Nov 08 18:31:49 user nova-compute[74820]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 18:31:49 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config' index='1'/>
Nov 08 18:31:49 user nova-compute[74820]:       <backingStore/>
Nov 08 18:31:49 user nova-compute[74820]:       <target dev='hda' bus='ide'/>
Nov 08 18:31:49 user nova-compute[74820]:       <readonly/>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='ide0-0-0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </disk>
Nov 08 18:31:49 user nova-compute[74820]:     <controller type='usb' index='0' model='none'>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='usb'/>
Nov 08 18:31:49 user nova-compute[74820]:     </controller>
Nov 08 18:31:49 user nova-compute[74820]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='pci.0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </controller>
Nov 08 18:31:49 user nova-compute[74820]:     <controller type='ide' index='0'>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='ide'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 18:31:49 user nova-compute[74820]:     </controller>
Nov 08 18:31:49 user nova-compute[74820]:     <interface type='ethernet'>
Nov 08 18:31:49 user nova-compute[74820]:       <mac address='fa:16:3e:f5:43:e0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <target dev='tap7c540edf-72'/>
Nov 08 18:31:49 user nova-compute[74820]:       <model type='virtio'/>
Nov 08 18:31:49 user nova-compute[74820]:       <mtu size='1442'/>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='net0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </interface>
Nov 08 18:31:49 user nova-compute[74820]:     <serial type='pty'>
Nov 08 18:31:49 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:49 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:49 user nova-compute[74820]:       <target type='isa-serial' port='0'>
Nov 08 18:31:49 user nova-compute[74820]:         <model name='isa-serial'/>
Nov 08 18:31:49 user nova-compute[74820]:       </target>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </serial>
Nov 08 18:31:49 user nova-compute[74820]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 18:31:49 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:49 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:49 user nova-compute[74820]:       <target type='serial' port='0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </console>
Nov 08 18:31:49 user nova-compute[74820]:     <input type='mouse' bus='ps2'>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='input0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </input>
Nov 08 18:31:49 user nova-compute[74820]:     <input type='keyboard' bus='ps2'>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='input1'/>
Nov 08 18:31:49 user nova-compute[74820]:     </input>
Nov 08 18:31:49 user nova-compute[74820]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 18:31:49 user nova-compute[74820]:       <listen type='address' address='0.0.0.0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </graphics>
Nov 08 18:31:49 user nova-compute[74820]:     <audio id='1' type='none'/>
Nov 08 18:31:49 user nova-compute[74820]:     <video>
Nov 08 18:31:49 user nova-compute[74820]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='video0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </video>
Nov 08 18:31:49 user nova-compute[74820]:     <memballoon model='virtio'>
Nov 08 18:31:49 user nova-compute[74820]:       <stats period='10'/>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='balloon0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:49 user nova-compute[74820]:     <rng model='virtio'>
Nov 08 18:31:49 user nova-compute[74820]:       <backend model='random'>/dev/urandom</backend>
Nov 08 18:31:49 user nova-compute[74820]:       <alias name='rng0'/>
Nov 08 18:31:49 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 18:31:49 user nova-compute[74820]:     </rng>
Nov 08 18:31:49 user nova-compute[74820]:   </devices>
Nov 08 18:31:49 user nova-compute[74820]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 18:31:49 user nova-compute[74820]:     <label>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</label>
Nov 08 18:31:49 user nova-compute[74820]:     <imagelabel>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</imagelabel>
Nov 08 18:31:49 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:49 user nova-compute[74820]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 18:31:49 user nova-compute[74820]:     <label>+64055:+108</label>
Nov 08 18:31:49 user nova-compute[74820]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 18:31:49 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:49 user nova-compute[74820]: </domain>
Nov 08 18:31:49 user nova-compute[74820]:  {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 18:31:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully detached device tap0b9dc916-5c from instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 from the live domain config.
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG os_vif [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b9dc916-5c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e91d5b16-ed26-40ec-9656-18c1e892e505) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:49 user nova-compute[74820]: INFO os_vif [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c')
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:49 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:31:49</nova:creationTime>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:31:49 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:49 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:owner>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:31:49 user nova-compute[74820]:   </nova:owner>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:49 user nova-compute[74820]:   <nova:ports>
Nov 08 18:31:49 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:31:49 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:31:49 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:49 user nova-compute[74820]:   </nova:ports>
Nov 08 18:31:49 user nova-compute[74820]: </nova:instance>
Nov 08 18:31:49 user nova-compute[74820]:  {{(pid=74820) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-deleted-0b9dc916-5c77-4494-8657-79f2b7b6ab69 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:49 user nova-compute[74820]: INFO nova.compute.manager [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Neutron deleted interface 0b9dc916-5c77-4494-8657-79f2b7b6ab69; detaching it from the instance and deleting it from the info cache
Nov 08 18:31:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.objects.instance [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Lazy-loading 'system_metadata' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.objects.instance [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Lazy-loading 'flavor' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.objects.base [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Object Instance<a2eddce3-e832-4737-be16-6d6a6ba7dc77> lazy-loaded attributes: system_metadata,flavor {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.network.os_vif_util [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Converting VIF {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.network.os_vif_util [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface> {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 18:31:50 user nova-compute[74820]:   <name>instance-00000007</name>
Nov 08 18:31:50 user nova-compute[74820]:   <uuid>a2eddce3-e832-4737-be16-6d6a6ba7dc77</uuid>
Nov 08 18:31:50 user nova-compute[74820]:   <metadata>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:50 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:31:49</nova:creationTime>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:31:50 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:owner>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:owner>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:ports>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:31:50 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:31:50 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:ports>
Nov 08 18:31:50 user nova-compute[74820]: </nova:instance>
Nov 08 18:31:50 user nova-compute[74820]:   </metadata>
Nov 08 18:31:50 user nova-compute[74820]:   <memory unit='KiB'>524288</memory>
Nov 08 18:31:50 user nova-compute[74820]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 18:31:50 user nova-compute[74820]:   <vcpu placement='static'>1</vcpu>
Nov 08 18:31:50 user nova-compute[74820]:   <resource>
Nov 08 18:31:50 user nova-compute[74820]:     <partition>/machine</partition>
Nov 08 18:31:50 user nova-compute[74820]:   </resource>
Nov 08 18:31:50 user nova-compute[74820]:   <sysinfo type='smbios'>
Nov 08 18:31:50 user nova-compute[74820]:     <system>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='version'>0.0.0</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='serial'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='uuid'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='family'>Virtual Machine</entry>
Nov 08 18:31:50 user nova-compute[74820]:     </system>
Nov 08 18:31:50 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:50 user nova-compute[74820]:   <os>
Nov 08 18:31:50 user nova-compute[74820]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 18:31:50 user nova-compute[74820]:     <boot dev='hd'/>
Nov 08 18:31:50 user nova-compute[74820]:     <smbios mode='sysinfo'/>
Nov 08 18:31:50 user nova-compute[74820]:   </os>
Nov 08 18:31:50 user nova-compute[74820]:   <features>
Nov 08 18:31:50 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:50 user nova-compute[74820]:     <apic/>
Nov 08 18:31:50 user nova-compute[74820]:     <vmcoreinfo state='on'/>
Nov 08 18:31:50 user nova-compute[74820]:   </features>
Nov 08 18:31:50 user nova-compute[74820]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 18:31:50 user nova-compute[74820]:     <model fallback='forbid'>Nehalem</model>
Nov 08 18:31:50 user nova-compute[74820]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 18:31:50 user nova-compute[74820]:     <feature policy='require' name='vme'/>
Nov 08 18:31:50 user nova-compute[74820]:     <feature policy='require' name='x2apic'/>
Nov 08 18:31:50 user nova-compute[74820]:     <feature policy='require' name='hypervisor'/>
Nov 08 18:31:50 user nova-compute[74820]:   </cpu>
Nov 08 18:31:50 user nova-compute[74820]:   <clock offset='utc'>
Nov 08 18:31:50 user nova-compute[74820]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 18:31:50 user nova-compute[74820]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 18:31:50 user nova-compute[74820]:     <timer name='hpet' present='no'/>
Nov 08 18:31:50 user nova-compute[74820]:   </clock>
Nov 08 18:31:50 user nova-compute[74820]:   <on_poweroff>destroy</on_poweroff>
Nov 08 18:31:50 user nova-compute[74820]:   <on_reboot>restart</on_reboot>
Nov 08 18:31:50 user nova-compute[74820]:   <on_crash>destroy</on_crash>
Nov 08 18:31:50 user nova-compute[74820]:   <devices>
Nov 08 18:31:50 user nova-compute[74820]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 18:31:50 user nova-compute[74820]:     <disk type='file' device='disk'>
Nov 08 18:31:50 user nova-compute[74820]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 18:31:50 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk' index='2'/>
Nov 08 18:31:50 user nova-compute[74820]:       <backingStore type='file' index='3'>
Nov 08 18:31:50 user nova-compute[74820]:         <format type='raw'/>
Nov 08 18:31:50 user nova-compute[74820]:         <source file='/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf'/>
Nov 08 18:31:50 user nova-compute[74820]:         <backingStore/>
Nov 08 18:31:50 user nova-compute[74820]:       </backingStore>
Nov 08 18:31:50 user nova-compute[74820]:       <target dev='vda' bus='virtio'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='virtio-disk0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </disk>
Nov 08 18:31:50 user nova-compute[74820]:     <disk type='file' device='cdrom'>
Nov 08 18:31:50 user nova-compute[74820]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 18:31:50 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config' index='1'/>
Nov 08 18:31:50 user nova-compute[74820]:       <backingStore/>
Nov 08 18:31:50 user nova-compute[74820]:       <target dev='hda' bus='ide'/>
Nov 08 18:31:50 user nova-compute[74820]:       <readonly/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='ide0-0-0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </disk>
Nov 08 18:31:50 user nova-compute[74820]:     <controller type='usb' index='0' model='none'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='usb'/>
Nov 08 18:31:50 user nova-compute[74820]:     </controller>
Nov 08 18:31:50 user nova-compute[74820]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='pci.0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </controller>
Nov 08 18:31:50 user nova-compute[74820]:     <controller type='ide' index='0'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='ide'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 18:31:50 user nova-compute[74820]:     </controller>
Nov 08 18:31:50 user nova-compute[74820]:     <interface type='ethernet'>
Nov 08 18:31:50 user nova-compute[74820]:       <mac address='fa:16:3e:f5:43:e0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <target dev='tap7c540edf-72'/>
Nov 08 18:31:50 user nova-compute[74820]:       <model type='virtio'/>
Nov 08 18:31:50 user nova-compute[74820]:       <mtu size='1442'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='net0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </interface>
Nov 08 18:31:50 user nova-compute[74820]:     <serial type='pty'>
Nov 08 18:31:50 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:50 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:50 user nova-compute[74820]:       <target type='isa-serial' port='0'>
Nov 08 18:31:50 user nova-compute[74820]:         <model name='isa-serial'/>
Nov 08 18:31:50 user nova-compute[74820]:       </target>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </serial>
Nov 08 18:31:50 user nova-compute[74820]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 18:31:50 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:50 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:50 user nova-compute[74820]:       <target type='serial' port='0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </console>
Nov 08 18:31:50 user nova-compute[74820]:     <input type='mouse' bus='ps2'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='input0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </input>
Nov 08 18:31:50 user nova-compute[74820]:     <input type='keyboard' bus='ps2'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='input1'/>
Nov 08 18:31:50 user nova-compute[74820]:     </input>
Nov 08 18:31:50 user nova-compute[74820]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 18:31:50 user nova-compute[74820]:       <listen type='address' address='0.0.0.0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </graphics>
Nov 08 18:31:50 user nova-compute[74820]:     <audio id='1' type='none'/>
Nov 08 18:31:50 user nova-compute[74820]:     <video>
Nov 08 18:31:50 user nova-compute[74820]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='video0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </video>
Nov 08 18:31:50 user nova-compute[74820]:     <memballoon model='virtio'>
Nov 08 18:31:50 user nova-compute[74820]:       <stats period='10'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='balloon0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:50 user nova-compute[74820]:     <rng model='virtio'>
Nov 08 18:31:50 user nova-compute[74820]:       <backend model='random'>/dev/urandom</backend>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='rng0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </rng>
Nov 08 18:31:50 user nova-compute[74820]:   </devices>
Nov 08 18:31:50 user nova-compute[74820]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 18:31:50 user nova-compute[74820]:     <label>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</label>
Nov 08 18:31:50 user nova-compute[74820]:     <imagelabel>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</imagelabel>
Nov 08 18:31:50 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:50 user nova-compute[74820]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 18:31:50 user nova-compute[74820]:     <label>+64055:+108</label>
Nov 08 18:31:50 user nova-compute[74820]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 18:31:50 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:50 user nova-compute[74820]: </domain>
Nov 08 18:31:50 user nova-compute[74820]:  {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface> {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6c:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap0b9dc916-5c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 18:31:50 user nova-compute[74820]:   <name>instance-00000007</name>
Nov 08 18:31:50 user nova-compute[74820]:   <uuid>a2eddce3-e832-4737-be16-6d6a6ba7dc77</uuid>
Nov 08 18:31:50 user nova-compute[74820]:   <metadata>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:50 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:31:49</nova:creationTime>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:31:50 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:owner>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:owner>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:ports>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:31:50 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:31:50 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:ports>
Nov 08 18:31:50 user nova-compute[74820]: </nova:instance>
Nov 08 18:31:50 user nova-compute[74820]:   </metadata>
Nov 08 18:31:50 user nova-compute[74820]:   <memory unit='KiB'>524288</memory>
Nov 08 18:31:50 user nova-compute[74820]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 18:31:50 user nova-compute[74820]:   <vcpu placement='static'>1</vcpu>
Nov 08 18:31:50 user nova-compute[74820]:   <resource>
Nov 08 18:31:50 user nova-compute[74820]:     <partition>/machine</partition>
Nov 08 18:31:50 user nova-compute[74820]:   </resource>
Nov 08 18:31:50 user nova-compute[74820]:   <sysinfo type='smbios'>
Nov 08 18:31:50 user nova-compute[74820]:     <system>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='version'>0.0.0</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='serial'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='uuid'>a2eddce3-e832-4737-be16-6d6a6ba7dc77</entry>
Nov 08 18:31:50 user nova-compute[74820]:       <entry name='family'>Virtual Machine</entry>
Nov 08 18:31:50 user nova-compute[74820]:     </system>
Nov 08 18:31:50 user nova-compute[74820]:   </sysinfo>
Nov 08 18:31:50 user nova-compute[74820]:   <os>
Nov 08 18:31:50 user nova-compute[74820]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 18:31:50 user nova-compute[74820]:     <boot dev='hd'/>
Nov 08 18:31:50 user nova-compute[74820]:     <smbios mode='sysinfo'/>
Nov 08 18:31:50 user nova-compute[74820]:   </os>
Nov 08 18:31:50 user nova-compute[74820]:   <features>
Nov 08 18:31:50 user nova-compute[74820]:     <acpi/>
Nov 08 18:31:50 user nova-compute[74820]:     <apic/>
Nov 08 18:31:50 user nova-compute[74820]:     <vmcoreinfo state='on'/>
Nov 08 18:31:50 user nova-compute[74820]:   </features>
Nov 08 18:31:50 user nova-compute[74820]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 18:31:50 user nova-compute[74820]:     <model fallback='forbid'>Nehalem</model>
Nov 08 18:31:50 user nova-compute[74820]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 18:31:50 user nova-compute[74820]:     <feature policy='require' name='vme'/>
Nov 08 18:31:50 user nova-compute[74820]:     <feature policy='require' name='x2apic'/>
Nov 08 18:31:50 user nova-compute[74820]:     <feature policy='require' name='hypervisor'/>
Nov 08 18:31:50 user nova-compute[74820]:   </cpu>
Nov 08 18:31:50 user nova-compute[74820]:   <clock offset='utc'>
Nov 08 18:31:50 user nova-compute[74820]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 18:31:50 user nova-compute[74820]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 18:31:50 user nova-compute[74820]:     <timer name='hpet' present='no'/>
Nov 08 18:31:50 user nova-compute[74820]:   </clock>
Nov 08 18:31:50 user nova-compute[74820]:   <on_poweroff>destroy</on_poweroff>
Nov 08 18:31:50 user nova-compute[74820]:   <on_reboot>restart</on_reboot>
Nov 08 18:31:50 user nova-compute[74820]:   <on_crash>destroy</on_crash>
Nov 08 18:31:50 user nova-compute[74820]:   <devices>
Nov 08 18:31:50 user nova-compute[74820]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 18:31:50 user nova-compute[74820]:     <disk type='file' device='disk'>
Nov 08 18:31:50 user nova-compute[74820]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 18:31:50 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk' index='2'/>
Nov 08 18:31:50 user nova-compute[74820]:       <backingStore type='file' index='3'>
Nov 08 18:31:50 user nova-compute[74820]:         <format type='raw'/>
Nov 08 18:31:50 user nova-compute[74820]:         <source file='/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf'/>
Nov 08 18:31:50 user nova-compute[74820]:         <backingStore/>
Nov 08 18:31:50 user nova-compute[74820]:       </backingStore>
Nov 08 18:31:50 user nova-compute[74820]:       <target dev='vda' bus='virtio'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='virtio-disk0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </disk>
Nov 08 18:31:50 user nova-compute[74820]:     <disk type='file' device='cdrom'>
Nov 08 18:31:50 user nova-compute[74820]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 18:31:50 user nova-compute[74820]:       <source file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/disk.config' index='1'/>
Nov 08 18:31:50 user nova-compute[74820]:       <backingStore/>
Nov 08 18:31:50 user nova-compute[74820]:       <target dev='hda' bus='ide'/>
Nov 08 18:31:50 user nova-compute[74820]:       <readonly/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='ide0-0-0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </disk>
Nov 08 18:31:50 user nova-compute[74820]:     <controller type='usb' index='0' model='none'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='usb'/>
Nov 08 18:31:50 user nova-compute[74820]:     </controller>
Nov 08 18:31:50 user nova-compute[74820]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='pci.0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </controller>
Nov 08 18:31:50 user nova-compute[74820]:     <controller type='ide' index='0'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='ide'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 18:31:50 user nova-compute[74820]:     </controller>
Nov 08 18:31:50 user nova-compute[74820]:     <interface type='ethernet'>
Nov 08 18:31:50 user nova-compute[74820]:       <mac address='fa:16:3e:f5:43:e0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <target dev='tap7c540edf-72'/>
Nov 08 18:31:50 user nova-compute[74820]:       <model type='virtio'/>
Nov 08 18:31:50 user nova-compute[74820]:       <mtu size='1442'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='net0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </interface>
Nov 08 18:31:50 user nova-compute[74820]:     <serial type='pty'>
Nov 08 18:31:50 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:50 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:50 user nova-compute[74820]:       <target type='isa-serial' port='0'>
Nov 08 18:31:50 user nova-compute[74820]:         <model name='isa-serial'/>
Nov 08 18:31:50 user nova-compute[74820]:       </target>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </serial>
Nov 08 18:31:50 user nova-compute[74820]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 18:31:50 user nova-compute[74820]:       <source path='/dev/pts/6'/>
Nov 08 18:31:50 user nova-compute[74820]:       <log file='/opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77/console.log' append='off'/>
Nov 08 18:31:50 user nova-compute[74820]:       <target type='serial' port='0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='serial0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </console>
Nov 08 18:31:50 user nova-compute[74820]:     <input type='mouse' bus='ps2'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='input0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </input>
Nov 08 18:31:50 user nova-compute[74820]:     <input type='keyboard' bus='ps2'>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='input1'/>
Nov 08 18:31:50 user nova-compute[74820]:     </input>
Nov 08 18:31:50 user nova-compute[74820]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 18:31:50 user nova-compute[74820]:       <listen type='address' address='0.0.0.0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </graphics>
Nov 08 18:31:50 user nova-compute[74820]:     <audio id='1' type='none'/>
Nov 08 18:31:50 user nova-compute[74820]:     <video>
Nov 08 18:31:50 user nova-compute[74820]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='video0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </video>
Nov 08 18:31:50 user nova-compute[74820]:     <memballoon model='virtio'>
Nov 08 18:31:50 user nova-compute[74820]:       <stats period='10'/>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='balloon0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </memballoon>
Nov 08 18:31:50 user nova-compute[74820]:     <rng model='virtio'>
Nov 08 18:31:50 user nova-compute[74820]:       <backend model='random'>/dev/urandom</backend>
Nov 08 18:31:50 user nova-compute[74820]:       <alias name='rng0'/>
Nov 08 18:31:50 user nova-compute[74820]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 18:31:50 user nova-compute[74820]:     </rng>
Nov 08 18:31:50 user nova-compute[74820]:   </devices>
Nov 08 18:31:50 user nova-compute[74820]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 18:31:50 user nova-compute[74820]:     <label>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</label>
Nov 08 18:31:50 user nova-compute[74820]:     <imagelabel>libvirt-a2eddce3-e832-4737-be16-6d6a6ba7dc77</imagelabel>
Nov 08 18:31:50 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:50 user nova-compute[74820]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 18:31:50 user nova-compute[74820]:     <label>+64055:+108</label>
Nov 08 18:31:50 user nova-compute[74820]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 18:31:50 user nova-compute[74820]:   </seclabel>
Nov 08 18:31:50 user nova-compute[74820]: </domain>
Nov 08 18:31:50 user nova-compute[74820]:  {{(pid=74820) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 18:31:50 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Detaching interface fa:16:3e:6c:ab:10 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0b9dc916-5c' not found.
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.network.os_vif_util [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Converting VIF {"id": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "address": "fa:16:3e:6c:ab:10", "network": {"id": "1a99df37-c923-4dda-935d-676a3606409c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1054698514", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9dc916-5c", "ovs_interfaceid": "0b9dc916-5c77-4494-8657-79f2b7b6ab69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.network.os_vif_util [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG os_vif [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b9dc916-5c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:31:50 user nova-compute[74820]: INFO os_vif [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=0b9dc916-5c77-4494-8657-79f2b7b6ab69,network=Network(1a99df37-c923-4dda-935d-676a3606409c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9dc916-5c')
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [req-a5a1644e-f373-46cb-9c21-ed2a966ece34 req-77428f1f-a099-45bd-9275-40ce120ef95c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:31:50 user nova-compute[74820]:   <nova:package version="0.0.0"/>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:name>tempest-device-tagging-server-553532392</nova:name>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:creationTime>2023-11-08 18:31:50</nova:creationTime>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:flavor name="m1.tiny">
Nov 08 18:31:50 user nova-compute[74820]:     <nova:memory>512</nova:memory>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:disk>1</nova:disk>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:swap>0</nova:swap>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:vcpus>1</nova:vcpus>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:flavor>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:owner>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:user uuid="bba75245b8d34d669ab6a0faa6c40330">tempest-TaggedAttachmentsTest-1398852168-project-member</nova:user>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:project uuid="e6e1f2856b5a49b9b23dedc7f4e0ba1c">tempest-TaggedAttachmentsTest-1398852168</nova:project>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:owner>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:31:50 user nova-compute[74820]:   <nova:ports>
Nov 08 18:31:50 user nova-compute[74820]:     <nova:port uuid="7c540edf-72b4-4381-a2fb-48cc243f9449">
Nov 08 18:31:50 user nova-compute[74820]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:31:50 user nova-compute[74820]:     </nova:port>
Nov 08 18:31:50 user nova-compute[74820]:   </nova:ports>
Nov 08 18:31:50 user nova-compute[74820]: </nova:instance>
Nov 08 18:31:50 user nova-compute[74820]:  {{(pid=74820) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:31:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:51 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:51 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7810MB free_disk=25.373573303222656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0004ee3-3c0b-4d9d-8e14-a99b459bbcf7 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "interface-a2eddce3-e832-4737-be16-6d6a6ba7dc77-0b9dc916-5c77-4494-8657-79f2b7b6ab69" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 23.048s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Applying migration context for instance a19102f1-af5a-4cb1-876f-8d053abed70b as it has an incoming, in-progress migration 565bebcc-f827-4164-8740-aaa9834ba06e. Migration status is post-migrating {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 18:31:51 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating resource usage from migration 565bebcc-f827-4164-8740-aaa9834ba06e
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e55b6e6b-6928-407d-b147-aa912277ec71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a2eddce3-e832-4737-be16-6d6a6ba7dc77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 133d6dc8-9328-4831-a247-d655d91d32a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 03b7e5da-f78f-423f-9e8d-77588b710547 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Migration 565bebcc-f827-4164-8740-aaa9834ba06e is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:31:51 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:31:52 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:31:52 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:31:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:31:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.886s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:31:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:31:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:55 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [{"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-a2eddce3-e832-4737-be16-6d6a6ba7dc77" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG nova.compute.manager [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-changed-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG nova.compute.manager [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Refreshing instance network info cache due to event network-changed-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] Acquiring lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] Acquired lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:31:56 user nova-compute[74820]: DEBUG nova.network.neutron [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Refreshing network info cache for port 99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "03b7e5da-f78f-423f-9e8d-77588b710547" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:57 user nova-compute[74820]: INFO nova.compute.manager [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Terminating instance
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.network.neutron [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Updated VIF entry in instance network info cache for port 99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.network.neutron [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Updating instance_info_cache with network_info: [{"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-65259c84-7827-4693-8102-aa5c63d67352 req-12f4f605-123e-4056-ae41-8b36ec12c984 service nova] Releasing lock "refresh_cache-03b7e5da-f78f-423f-9e8d-77588b710547" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:57 user nova-compute[74820]: INFO nova.compute.manager [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Terminating instance
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-c708eca2-a200-49ad-921e-8248d1de3d8e req-bd5afa31-8508-4227-9c59-aeb4d9b31ac1 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-vif-unplugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c708eca2-a200-49ad-921e-8248d1de3d8e req-bd5afa31-8508-4227-9c59-aeb4d9b31ac1 service nova] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c708eca2-a200-49ad-921e-8248d1de3d8e req-bd5afa31-8508-4227-9c59-aeb4d9b31ac1 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c708eca2-a200-49ad-921e-8248d1de3d8e req-bd5afa31-8508-4227-9c59-aeb4d9b31ac1 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-c708eca2-a200-49ad-921e-8248d1de3d8e req-bd5afa31-8508-4227-9c59-aeb4d9b31ac1 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] No waiting events found dispatching network-vif-unplugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-c708eca2-a200-49ad-921e-8248d1de3d8e req-bd5afa31-8508-4227-9c59-aeb4d9b31ac1 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-vif-unplugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-unplugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-unplugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-unplugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:58 user nova-compute[74820]: WARNING nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state active and task_state deleting.
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:58 user nova-compute[74820]: WARNING nova.compute.manager [req-ab86b1e3-0b37-4653-a20f-39e2a4ea70bb req-acb85a95-df8b-4364-9375-8dc6cf49ae98 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state active and task_state deleting.
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Instance destroyed successfully.
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.objects.instance [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'resources' on Instance uuid 03b7e5da-f78f-423f-9e8d-77588b710547 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-929490939',display_name='tempest-AttachVolumeNegativeTest-server-929490939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-929490939',id=13,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcmuSkw2lVgZLTqICtcZJHJKfuZCHmE3MHdsPUZvUz1+czR3blcZWG3BB/sPistMwWSqzbeo5GbsE8J7jPSxexLH7zHo9hDYoTDfzmAUXRvKBkAUD9n1t0ZN86i3yhDqA==',key_name='tempest-keypair-1178429342',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-d0f240kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:30:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=03b7e5da-f78f-423f-9e8d-77588b710547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "address": "fa:16:3e:99:85:47", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bf6bcf-2c", "ovs_interfaceid": "99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG os_vif [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99bf6bcf-2c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Instance destroyed successfully.
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.objects.instance [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lazy-loading 'resources' on Instance uuid c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6bf4a96-fed0-4deb-9031-9d2189cd4f75) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:27:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1961637594',display_name='tempest-VolumesAssistedSnapshotsTest-server-1961637594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1961637594',id=9,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOq1nCn//Uk47KU39ssA5smYtK7mPFFFcJs1qlzE4FtrhNpbSf7TBgXxzuauUQVkpaIKOXDG5qZ2FOpDomeceKHCiiF6hYCJoXSHIvIL/X3RNP0/lHrSW7QpY8hgYRzHw==',key_name='tempest-keypair-1559265386',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='292b3d04a2a64d65a673b680c0cb2a6e',ramdisk_id='',reservation_id='r-kqgbyezq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-902008966',owner_user_name='tempest-VolumesAssistedSnapshotsTest-902008966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24abb824ef2f4ee9a37c19a36fd98127',uuid=c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Converting VIF {"id": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "address": "fa:16:3e:48:d8:9a", "network": {"id": "859cb6da-cf25-4308-8404-9147835bfa16", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-63877427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "292b3d04a2a64d65a673b680c0cb2a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33dc19fe-a1", "ovs_interfaceid": "33dc19fe-a1fb-4820-b95a-98605ad9c595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG os_vif [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33dc19fe-a1, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:58 user nova-compute[74820]: INFO os_vif [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:85:47,bridge_name='br-int',has_traffic_filtering=True,id=99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bf6bcf-2c')
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Deleting instance files /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547_del
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Deletion of /opt/stack/data/nova/instances/03b7e5da-f78f-423f-9e8d-77588b710547_del complete
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=683c452c-82c6-421c-b6b3-a90c37be9423) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:31:58 user nova-compute[74820]: INFO os_vif [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:d8:9a,bridge_name='br-int',has_traffic_filtering=True,id=33dc19fe-a1fb-4820-b95a-98605ad9c595,network=Network(859cb6da-cf25-4308-8404-9147835bfa16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33dc19fe-a1')
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Deleting instance files /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9_del
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Deletion of /opt/stack/data/nova/instances/c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9_del complete
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.compute.manager [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Took 1.82 seconds to destroy the instance on the hypervisor.
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:31:58 user nova-compute[74820]: INFO nova.compute.manager [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 08 18:31:58 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:31:58 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:31:59 user nova-compute[74820]: DEBUG nova.compute.manager [req-5aa679e1-793e-49c6-82a1-182d66140c60 req-11d5a938-3464-4ed4-887f-96baaa84e488 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:31:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5aa679e1-793e-49c6-82a1-182d66140c60 req-11d5a938-3464-4ed4-887f-96baaa84e488 service nova] Acquiring lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:31:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5aa679e1-793e-49c6-82a1-182d66140c60 req-11d5a938-3464-4ed4-887f-96baaa84e488 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:31:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5aa679e1-793e-49c6-82a1-182d66140c60 req-11d5a938-3464-4ed4-887f-96baaa84e488 service nova] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:31:59 user nova-compute[74820]: DEBUG nova.compute.manager [req-5aa679e1-793e-49c6-82a1-182d66140c60 req-11d5a938-3464-4ed4-887f-96baaa84e488 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] No waiting events found dispatching network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:31:59 user nova-compute[74820]: WARNING nova.compute.manager [req-5aa679e1-793e-49c6-82a1-182d66140c60 req-11d5a938-3464-4ed4-887f-96baaa84e488 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received unexpected event network-vif-plugged-33dc19fe-a1fb-4820-b95a-98605ad9c595 for instance with vm_state active and task_state deleting.
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:00 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Took 1.22 seconds to deallocate network for instance.
Nov 08 18:32:00 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Took 1.29 seconds to deallocate network for instance.
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-99a89dda-90cb-4058-858f-db2761c468f7 req-2e2dd8b6-36a5-49aa-9fd3-18d87e52e454 service nova] [instance: c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9] Received event network-vif-deleted-33dc19fe-a1fb-4820-b95a-98605ad9c595 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.447s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:00 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Deleted allocations for instance c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:00 user nova-compute[74820]: WARNING nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state deleted and task_state None.
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-unplugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-unplugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:00 user nova-compute[74820]: WARNING nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-unplugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state deleted and task_state None.
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Acquiring lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] Lock "03b7e5da-f78f-423f-9e8d-77588b710547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] No waiting events found dispatching network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:00 user nova-compute[74820]: WARNING nova.compute.manager [req-8deee83b-cb74-465b-95d4-5ee10b4a24c6 req-1dd17db1-9326-4c0d-ad16-4723bda7d164 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received unexpected event network-vif-plugged-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c for instance with vm_state deleted and task_state None.
Nov 08 18:32:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-687566bc-300a-456a-8a3d-c0fb226a753f tempest-VolumesAssistedSnapshotsTest-902008966 tempest-VolumesAssistedSnapshotsTest-902008966-project-member] Lock "c12aacb0-15d9-4031-ba0d-67ccbdcc4ea9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.493s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:01 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:32:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:32:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:01 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Deleted allocations for instance 03b7e5da-f78f-423f-9e8d-77588b710547
Nov 08 18:32:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-acfd3459-66d8-45ab-a1c6-0f9a1137815e tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "03b7e5da-f78f-423f-9e8d-77588b710547" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.220s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-dbc6fb3b-e8c4-465f-984d-9220616493c2 req-c763add0-584b-4380-a96c-a1cd46a07332 service nova] [instance: 03b7e5da-f78f-423f-9e8d-77588b710547] Received event network-vif-deleted-99bf6bcf-2c2d-4af1-ac55-222c4c8dbc2c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '133d6dc8-9328-4831-a247-d655d91d32a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'serial': 'c97896dc-62f2-489c-9a8a-7b83093bd1dc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvIhlqVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'f3577301-887e-4294-a6fa-000e62e95c85'}, 'status': 'reserved', 'instance': '133d6dc8-9328-4831-a247-d655d91d32a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3577301-887e-4294-a6fa-000e62e95c85', 'serial'} {{(pid=74820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:32:07 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:07 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:07 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6df463-be99-4613-9bc6-89c7c30e4e95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:32:07 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885ad18-abfe-41bb-9a59-393744bc3576]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc] added
Nov 08 18:32:07 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[570cf96d-8cd4-4c22-a284-07a7736c953b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[56acab8d-481a-442d-8dcb-bddf1099aa1e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYmJSpbG {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYmJSpbG" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c8361d-42b1-4ccc-bd83-eb540fe7914d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYmJSpbG'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9fe35-334e-40cf-b24a-6e3f5b944f61]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba51c320-7019-4a6f-9dd4-f27653f1ca84]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:07 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:07 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec3ff7f-29d2-4527-b93b-5848198561ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]
Nov 08 18:32:07 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.
Nov 08 18:32:07 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a08ff-0080-4dd9-a30b-67d9f98b4edd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20cb803-14b8-4818-8cf3-c13881b2d788]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:07 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:07 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:07 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dab0f2b-7d0f-4221-b1d0-1e7a761dd09e]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23838633165383137', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:32:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838633165383137', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:32:08 user nova-compute[74820]: DEBUG nova.objects.instance [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lazy-loading 'flavor' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Starting finish_migration {{(pid=74820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:32:09 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Creating image(s)
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk. size=21474836480 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk 21474836480 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk 21474836480" returned: 0 in 0.070s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Ensure instance console log exists: /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start _get_guest_xml network_info=[{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'f23c9342-2b71-48ac-9ceb-5023ce687e2c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a19102f1-af5a-4cb1-876f-8d053abed70b', 'attached_at': '2023-11-08T18:32:09.000000', 'detached_at': '', 'volume_id': 'b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'serial': 'b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:32:09 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:09 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:32:09 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:09 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:09 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af0682-f5bd-4e91-81c6-e477a90e5062]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:32:09 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdfbeea-f7b1-43f0-a93f-65444a97f8c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c] added
Nov 08 18:32:09 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2850d4-9efe-4e58-9178-8404b50e091c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[907a31ac-15d3-4674-aae2-d0cda74a3f37]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArcIaCeV {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArcIaCeV" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66d319-6118-4c3d-9827-c7572c4baad2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ArcIaCeV'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e29d69-f49e-448d-a769-2ef00323c089]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef22be4-4c3f-48ea-ad35-485f9de68d98]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dcda81-c139-426c-ab8a-d85b07d906fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]
Nov 08 18:32:10 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.
Nov 08 18:32:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448c7b2-28c6-490c-af7a-07389ba89a34]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[85033f44-2134-473f-9e4b-ceffe07c2830]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:10 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001599d-4caa-4aba-89de-5d7fdb8081c4]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 316669952 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 465567744 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '26366333637613330', 'path': '/dev/sdg'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366333637613330', 'path': '/dev/sdg'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 601882624 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:31:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:32:11 user nova-compute[74820]:   <uuid>a19102f1-af5a-4cb1-876f-8d053abed70b</uuid>
Nov 08 18:32:11 user nova-compute[74820]:   <name>instance-00000005</name>
Nov 08 18:32:11 user nova-compute[74820]:   <memory>2097152</memory>
Nov 08 18:32:11 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:32:11 user nova-compute[74820]:   <metadata>
Nov 08 18:32:11 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:32:11 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:32:11 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherB-server-276469762</nova:name>
Nov 08 18:32:11 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:32:09</nova:creationTime>
Nov 08 18:32:11 user nova-compute[74820]:       <nova:flavor name="m1.small">
Nov 08 18:32:11 user nova-compute[74820]:         <nova:memory>2048</nova:memory>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:disk>20</nova:disk>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:32:11 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:32:11 user nova-compute[74820]:       <nova:owner>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:user uuid="8d7a66f28dd1417980df3a2f3a64bc0e">tempest-ServerActionsTestOtherB-740424869-project-member</nova:user>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:project uuid="e230a1c67e924522b88cfc57decccb17">tempest-ServerActionsTestOtherB-740424869</nova:project>
Nov 08 18:32:11 user nova-compute[74820]:       </nova:owner>
Nov 08 18:32:11 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:32:11 user nova-compute[74820]:       <nova:ports>
Nov 08 18:32:11 user nova-compute[74820]:         <nova:port uuid="85125f2a-e0c8-4893-8e27-7036ee1bb847">
Nov 08 18:32:11 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:32:11 user nova-compute[74820]:         </nova:port>
Nov 08 18:32:11 user nova-compute[74820]:       </nova:ports>
Nov 08 18:32:11 user nova-compute[74820]:     </nova:instance>
Nov 08 18:32:11 user nova-compute[74820]:   </metadata>
Nov 08 18:32:11 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:32:11 user nova-compute[74820]:     <system>
Nov 08 18:32:11 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:32:11 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:32:11 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:32:11 user nova-compute[74820]:       <entry name="serial">a19102f1-af5a-4cb1-876f-8d053abed70b</entry>
Nov 08 18:32:11 user nova-compute[74820]:       <entry name="uuid">a19102f1-af5a-4cb1-876f-8d053abed70b</entry>
Nov 08 18:32:11 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:32:11 user nova-compute[74820]:     </system>
Nov 08 18:32:11 user nova-compute[74820]:   </sysinfo>
Nov 08 18:32:11 user nova-compute[74820]:   <os>
Nov 08 18:32:11 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:32:11 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:32:11 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:32:11 user nova-compute[74820]:   </os>
Nov 08 18:32:11 user nova-compute[74820]:   <features>
Nov 08 18:32:11 user nova-compute[74820]:     <acpi/>
Nov 08 18:32:11 user nova-compute[74820]:     <apic/>
Nov 08 18:32:11 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:32:11 user nova-compute[74820]:   </features>
Nov 08 18:32:11 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:32:11 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:32:11 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:32:11 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:32:11 user nova-compute[74820]:   </clock>
Nov 08 18:32:11 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:32:11 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:32:11 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:32:11 user nova-compute[74820]:   </cpu>
Nov 08 18:32:11 user nova-compute[74820]:   <devices>
Nov 08 18:32:11 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:32:11 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:32:11 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk"/>
Nov 08 18:32:11 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:32:11 user nova-compute[74820]:     </disk>
Nov 08 18:32:11 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:32:11 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:11 user nova-compute[74820]:       <source dev="/dev/sdg"/>
Nov 08 18:32:11 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:32:11 user nova-compute[74820]:       <serial>b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c</serial>
Nov 08 18:32:11 user nova-compute[74820]:     </disk>
Nov 08 18:32:11 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:32:11 user nova-compute[74820]:       <mac address="fa:16:3e:33:c7:d1"/>
Nov 08 18:32:11 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:32:11 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:32:11 user nova-compute[74820]:       <target dev="tap85125f2a-e0"/>
Nov 08 18:32:11 user nova-compute[74820]:     </interface>
Nov 08 18:32:11 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:32:11 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/console.log" append="off"/>
Nov 08 18:32:11 user nova-compute[74820]:     </serial>
Nov 08 18:32:11 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:32:11 user nova-compute[74820]:     <video>
Nov 08 18:32:11 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:32:11 user nova-compute[74820]:     </video>
Nov 08 18:32:11 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:32:11 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:32:11 user nova-compute[74820]:     </rng>
Nov 08 18:32:11 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:32:11 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:32:11 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:32:11 user nova-compute[74820]:     </memballoon>
Nov 08 18:32:11 user nova-compute[74820]:   </devices>
Nov 08 18:32:11 user nova-compute[74820]: </domain>
Nov 08 18:32:11 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:31:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1489345576-network", "vif_mac": "fa:16:3e:33:c7:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG os_vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '532370fb-be92-5fb5-97c0-d2ab2c7d0977', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85125f2a-e0, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85125f2a-e0, col_values=(('qos', UUID('c7e372ec-356a-41f7-bc5b-0bfddb60ee91')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85125f2a-e0, col_values=(('external_ids', {'iface-id': '85125f2a-e0c8-4893-8e27-7036ee1bb847', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c7:d1', 'vm-uuid': 'a19102f1-af5a-4cb1-876f-8d053abed70b'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:11 user nova-compute[74820]: INFO os_vif [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0')
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] No VIF found with MAC fa:16:3e:33:c7:d1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 645922816 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:11 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:32:11 user nova-compute[74820]: INFO nova.compute.claims [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Claim successful on node user
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 786432000 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 944766976 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:32:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:32:12 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.policy [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23005c9177444a5da028f8f60202e1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f1ade1323846c39c48886010ea85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:32:13 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Creating image(s)
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "/opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "/opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "/opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.223s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk 1073741824" returned: 0 in 0.064s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-14491953-e9c5-4294-a2f1-60e70f53b071 req-c25a4dce-6f02-4705-bff0-8321dd0adc4b service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14491953-e9c5-4294-a2f1-60e70f53b071 req-c25a4dce-6f02-4705-bff0-8321dd0adc4b service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14491953-e9c5-4294-a2f1-60e70f53b071 req-c25a4dce-6f02-4705-bff0-8321dd0adc4b service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14491953-e9c5-4294-a2f1-60e70f53b071 req-c25a4dce-6f02-4705-bff0-8321dd0adc4b service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-14491953-e9c5-4294-a2f1-60e70f53b071 req-c25a4dce-6f02-4705-bff0-8321dd0adc4b service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:13 user nova-compute[74820]: WARNING nova.compute.manager [req-14491953-e9c5-4294-a2f1-60e70f53b071 req-c25a4dce-6f02-4705-bff0-8321dd0adc4b service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state resize_finish.
Nov 08 18:32:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvIhlqVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'f3577301-887e-4294-a6fa-000e62e95c85'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:32:13 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed945d01-4773-4062-8678-5de44c5f3374]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:32:13 user nova-compute[74820]: No targets found.
Nov 08 18:32:13 user nova-compute[74820]: iSNS:
Nov 08 18:32:13 user nova-compute[74820]: No targets found.
Nov 08 18:32:13 user nova-compute[74820]: STATIC:
Nov 08 18:32:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:32:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:32:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:32:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85
Nov 08 18:32:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce
Nov 08 18:32:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc
Nov 08 18:32:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:13 user nova-compute[74820]: FIRMWARE:
Nov 08 18:32:13 user nova-compute[74820]: No targets found.
Nov 08 18:32:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:32:13 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:32:13 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:32:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[248084a4-8fc5-4ba1-9e28-80f9acc42479]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.275s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Successfully created port: 08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a09ad1-d3c8-4cd9-a50a-7eddbbeebb5a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:14 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 (non-flash)
Nov 08 18:32:14 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:14 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c21ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85'): ({'sdf'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Removing single pathed devices sdf {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef18c3-4d24-406c-a5ff-6135dc2bb7bc]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cf62fa-7118-4437-b232-a94420bdfecc]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Flushing IO for device /dev/sdf {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93a831-b67b-4b3f-bba0-a892542c7902]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6284b46a-a21b-4db2-9914-66572d51afae]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3d6ce-51b6-4100-95fa-3c9248e12b74]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Cannot resize image /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Ensure instance console log exists: /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f67098-d854-45fd-be9a-22d8c718feb4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260]
Nov 08 18:32:14 user nova-compute[74820]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85, portal: 172.16.0.220,3260] successful.
Nov 08 18:32:14 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3577301-887e-4294-a6fa-000e62e95c85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41bfcb-c59e-4166-827c-2cff7513c4ab]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] <== disconnect_volume: return (491ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '133d6dc8-9328-4831-a247-d655d91d32a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'serial'} {{(pid=74820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] swap_volume: removing Cinder connection for volume f3577301-887e-4294-a6fa-000e62e95c85 {{(pid=74820) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Successfully updated port: 08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquired lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-changed-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Refreshing instance network info cache due to event network-changed-08ae7236-8687-44f7-aa2f-769b535110cd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] Acquiring lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:32:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updating instance_info_cache with network_info: [{"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Releasing lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Instance network_info: |[{"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] Acquired lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Refreshing network info cache for port 08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Start _get_guest_xml network_info=[{"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:32:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1093161186',display_name='tempest-VolumesSnapshotTestJSON-instance-1093161186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1093161186',id=15,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhEZaXxZId5OxEoL0tz8ndlytEpKzD4qaRCQ6MvLapAr3JJ65zIhMDKE5XajSI+OU0HnEUQmNjGJ5KHQqXI0FZzapvRfHjT4y43I5Bkm69TH4swOBVvQQ94H5EjLx9ysw==',key_name='tempest-keypair-818155430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f1ade1323846c39c48886010ea85e9',ramdisk_id='',reservation_id='r-9kaqfb19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1628967070',owner_user_name='tempest-VolumesSnapshotTestJSON-1628967070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23005c9177444a5da028f8f60202e1fc',uuid=3193361a-b8aa-4d53-a7ef-7bb70af53303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converting VIF {"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'pci_devices' on Instance uuid 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:32:15 user nova-compute[74820]:   <uuid>3193361a-b8aa-4d53-a7ef-7bb70af53303</uuid>
Nov 08 18:32:15 user nova-compute[74820]:   <name>instance-0000000f</name>
Nov 08 18:32:15 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:32:15 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:32:15 user nova-compute[74820]:   <metadata>
Nov 08 18:32:15 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:32:15 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:32:15 user nova-compute[74820]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1093161186</nova:name>
Nov 08 18:32:15 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:32:15</nova:creationTime>
Nov 08 18:32:15 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:32:15 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:32:15 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:32:15 user nova-compute[74820]:       <nova:owner>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:user uuid="23005c9177444a5da028f8f60202e1fc">tempest-VolumesSnapshotTestJSON-1628967070-project-member</nova:user>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:project uuid="53f1ade1323846c39c48886010ea85e9">tempest-VolumesSnapshotTestJSON-1628967070</nova:project>
Nov 08 18:32:15 user nova-compute[74820]:       </nova:owner>
Nov 08 18:32:15 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:32:15 user nova-compute[74820]:       <nova:ports>
Nov 08 18:32:15 user nova-compute[74820]:         <nova:port uuid="08ae7236-8687-44f7-aa2f-769b535110cd">
Nov 08 18:32:15 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 18:32:15 user nova-compute[74820]:         </nova:port>
Nov 08 18:32:15 user nova-compute[74820]:       </nova:ports>
Nov 08 18:32:15 user nova-compute[74820]:     </nova:instance>
Nov 08 18:32:15 user nova-compute[74820]:   </metadata>
Nov 08 18:32:15 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:32:15 user nova-compute[74820]:     <system>
Nov 08 18:32:15 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:32:15 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:32:15 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:32:15 user nova-compute[74820]:       <entry name="serial">3193361a-b8aa-4d53-a7ef-7bb70af53303</entry>
Nov 08 18:32:15 user nova-compute[74820]:       <entry name="uuid">3193361a-b8aa-4d53-a7ef-7bb70af53303</entry>
Nov 08 18:32:15 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:32:15 user nova-compute[74820]:     </system>
Nov 08 18:32:15 user nova-compute[74820]:   </sysinfo>
Nov 08 18:32:15 user nova-compute[74820]:   <os>
Nov 08 18:32:15 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:32:15 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:32:15 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:32:15 user nova-compute[74820]:   </os>
Nov 08 18:32:15 user nova-compute[74820]:   <features>
Nov 08 18:32:15 user nova-compute[74820]:     <acpi/>
Nov 08 18:32:15 user nova-compute[74820]:     <apic/>
Nov 08 18:32:15 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:32:15 user nova-compute[74820]:   </features>
Nov 08 18:32:15 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:32:15 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:32:15 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:32:15 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:32:15 user nova-compute[74820]:   </clock>
Nov 08 18:32:15 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:32:15 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:32:15 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:32:15 user nova-compute[74820]:   </cpu>
Nov 08 18:32:15 user nova-compute[74820]:   <devices>
Nov 08 18:32:15 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:32:15 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:32:15 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk"/>
Nov 08 18:32:15 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:32:15 user nova-compute[74820]:     </disk>
Nov 08 18:32:15 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:32:15 user nova-compute[74820]:       <mac address="fa:16:3e:fb:68:7a"/>
Nov 08 18:32:15 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:32:15 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:32:15 user nova-compute[74820]:       <target dev="tap08ae7236-86"/>
Nov 08 18:32:15 user nova-compute[74820]:     </interface>
Nov 08 18:32:15 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:32:15 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/console.log" append="off"/>
Nov 08 18:32:15 user nova-compute[74820]:     </serial>
Nov 08 18:32:15 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:32:15 user nova-compute[74820]:     <video>
Nov 08 18:32:15 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:32:15 user nova-compute[74820]:     </video>
Nov 08 18:32:15 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:32:15 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:32:15 user nova-compute[74820]:     </rng>
Nov 08 18:32:15 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:32:15 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:32:15 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:32:15 user nova-compute[74820]:     </memballoon>
Nov 08 18:32:15 user nova-compute[74820]:   </devices>
Nov 08 18:32:15 user nova-compute[74820]: </domain>
Nov 08 18:32:15 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1093161186',display_name='tempest-VolumesSnapshotTestJSON-instance-1093161186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1093161186',id=15,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhEZaXxZId5OxEoL0tz8ndlytEpKzD4qaRCQ6MvLapAr3JJ65zIhMDKE5XajSI+OU0HnEUQmNjGJ5KHQqXI0FZzapvRfHjT4y43I5Bkm69TH4swOBVvQQ94H5EjLx9ysw==',key_name='tempest-keypair-818155430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f1ade1323846c39c48886010ea85e9',ramdisk_id='',reservation_id='r-9kaqfb19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1628967070',owner_user_name='tempest-VolumesSnapshotTestJSON-1628967070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23005c9177444a5da028f8f60202e1fc',uuid=3193361a-b8aa-4d53-a7ef-7bb70af53303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converting VIF {"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG os_vif [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab4c1d22-e11a-5446-a94a-629e3b760431', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08ae7236-86, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08ae7236-86, col_values=(('qos', UUID('82bd082a-b172-4671-989e-6fc7f66e3b34')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08ae7236-86, col_values=(('external_ids', {'iface-id': '08ae7236-8687-44f7-aa2f-769b535110cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:68:7a', 'vm-uuid': '3193361a-b8aa-4d53-a7ef-7bb70af53303'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:15 user nova-compute[74820]: INFO os_vif [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86')
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No VIF found with MAC fa:16:3e:fb:68:7a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] swap_volume: Updating volume f3577301-887e-4294-a6fa-000e62e95c85 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "uYmJSpbG", "auth_password": "2w1mqfirznvMYs", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "c97896dc-62f2-489c-9a8a-7b83093bd1dc"}, "status": "reserved", "instance": "133d6dc8-9328-4831-a247-d655d91d32a9", "attached_at": "", "detached_at": "", "volume_id": "c97896dc-62f2-489c-9a8a-7b83093bd1dc", "serial": "c97896dc-62f2-489c-9a8a-7b83093bd1dc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'no_device': None, 'attachment_id': '4cd8c985-4f0e-489c-8c93-62da3ebec92c'} {{(pid=74820) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-641d9369-5741-4b6d-baa2-e3c6f8102ef8 tempest-TestVolumeSwap-1979923638 tempest-TestVolumeSwap-1979923638-project-admin] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 65.128s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updated VIF entry in instance network info cache for port 08ae7236-8687-44f7-aa2f-769b535110cd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updating instance_info_cache with network_info: [{"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1eecda0f-0526-4a35-9108-ff4eb5db5445 req-b1bb1f61-e6a4-4ed9-ae33-92baa40893d9 service nova] Releasing lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:32:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance running successfully.
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Failed to set time: agent not configured {{(pid=74820) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 18:32:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-92a9f261-6817-432a-97bc-26925595f383 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] finish_migration finished successfully. {{(pid=74820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-0a1960d6-5013-4af2-a15e-78f7f21db5d2 req-b9249f20-5702-4d87-b463-37a9f4745802 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0a1960d6-5013-4af2-a15e-78f7f21db5d2 req-b9249f20-5702-4d87-b463-37a9f4745802 service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0a1960d6-5013-4af2-a15e-78f7f21db5d2 req-b9249f20-5702-4d87-b463-37a9f4745802 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0a1960d6-5013-4af2-a15e-78f7f21db5d2 req-b9249f20-5702-4d87-b463-37a9f4745802 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-0a1960d6-5013-4af2-a15e-78f7f21db5d2 req-b9249f20-5702-4d87-b463-37a9f4745802 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:16 user nova-compute[74820]: WARNING nova.compute.manager [req-0a1960d6-5013-4af2-a15e-78f7f21db5d2 req-b9249f20-5702-4d87-b463-37a9f4745802 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state resize_finish.
Nov 08 18:32:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:16 user nova-compute[74820]: INFO nova.compute.manager [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Detaching volume c97896dc-62f2-489c-9a8a-7b83093bd1dc
Nov 08 18:32:16 user nova-compute[74820]: INFO nova.virt.block_device [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Attempting to driver detach volume c97896dc-62f2-489c-9a8a-7b83093bd1dc from mountpoint /dev/vdb
Nov 08 18:32:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Attempting to detach device vdb from instance 133d6dc8-9328-4831-a247-d655d91d32a9 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:32:16 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:16 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:32:16 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:32:16 user nova-compute[74820]:   <serial>c97896dc-62f2-489c-9a8a-7b83093bd1dc</serial>
Nov 08 18:32:16 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:32:16 user nova-compute[74820]: </disk>
Nov 08 18:32:16 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:32:16 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Successfully detached device vdb from instance 133d6dc8-9328-4831-a247-d655d91d32a9 from the persistent domain config.
Nov 08 18:32:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 133d6dc8-9328-4831-a247-d655d91d32a9 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:32:16 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:16 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:32:16 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:32:16 user nova-compute[74820]:   <serial>c97896dc-62f2-489c-9a8a-7b83093bd1dc</serial>
Nov 08 18:32:16 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:32:16 user nova-compute[74820]: </disk>
Nov 08 18:32:16 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:32:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] No waiting events found dispatching network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:18 user nova-compute[74820]: WARNING nova.compute.manager [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received unexpected event network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd for instance with vm_state building and task_state spawning.
Nov 08 18:32:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] No waiting events found dispatching network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:18 user nova-compute[74820]: WARNING nova.compute.manager [req-a158d390-81e4-4296-9073-576c73dfa487 req-9fc9a916-7860-4d6c-8fa3-8ef5d0d3f9cd service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received unexpected event network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd for instance with vm_state building and task_state spawning.
Nov 08 18:32:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:19 user nova-compute[74820]: INFO nova.compute.manager [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Terminating instance
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Instance spawned successfully.
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:32:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: INFO nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-e103af69-06e9-47b3-9fd0-e3d86f456ca2 req-6b813cb1-d54f-4dbb-87da-f8985171aa9e service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-unplugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e103af69-06e9-47b3-9fd0-e3d86f456ca2 req-6b813cb1-d54f-4dbb-87da-f8985171aa9e service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e103af69-06e9-47b3-9fd0-e3d86f456ca2 req-6b813cb1-d54f-4dbb-87da-f8985171aa9e service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e103af69-06e9-47b3-9fd0-e3d86f456ca2 req-6b813cb1-d54f-4dbb-87da-f8985171aa9e service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-e103af69-06e9-47b3-9fd0-e3d86f456ca2 req-6b813cb1-d54f-4dbb-87da-f8985171aa9e service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-unplugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-e103af69-06e9-47b3-9fd0-e3d86f456ca2 req-6b813cb1-d54f-4dbb-87da-f8985171aa9e service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-unplugged-7c540edf-72b4-4381-a2fb-48cc243f9449 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:32:20 user nova-compute[74820]: INFO nova.compute.manager [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Took 8.35 seconds to build instance.
Nov 08 18:32:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0b537741-6a51-4332-9b10-17f27dc28a0c tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.903s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Instance destroyed successfully.
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.objects.instance [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lazy-loading 'resources' on Instance uuid a2eddce3-e832-4737-be16-6d6a6ba7dc77 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T18:27:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-553532392',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-553532392',id=7,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFiNwEzbqfWTwdwTNoIT3376uR8rydruoS6pQhLFDXijARMsW6+73lnxmkFdNRyqBQvHefF9fB46sWcRWc6l8x8sWDEnQlp9JEaQ0uvmnjzzlx3aoV1vmnfoOzJQPSEow==',key_name='tempest-keypair-1048642869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e1f2856b5a49b9b23dedc7f4e0ba1c',ramdisk_id='',reservation_id='r-2uwoafus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1398852168',owner_user_name='tempest-TaggedAttachmentsTest-1398852168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bba75245b8d34d669ab6a0faa6c40330',uuid=a2eddce3-e832-4737-be16-6d6a6ba7dc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converting VIF {"id": "7c540edf-72b4-4381-a2fb-48cc243f9449", "address": "fa:16:3e:f5:43:e0", "network": {"id": "702c8616-f533-464d-abfe-a4671cfb8698", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-833471396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e1f2856b5a49b9b23dedc7f4e0ba1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c540edf-72", "ovs_interfaceid": "7c540edf-72b4-4381-a2fb-48cc243f9449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG os_vif [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c540edf-72, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65b3e9e1-6650-4217-89e2-853f15414d16) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:32:20 user nova-compute[74820]: INFO os_vif [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:43:e0,bridge_name='br-int',has_traffic_filtering=True,id=7c540edf-72b4-4381-a2fb-48cc243f9449,network=Network(702c8616-f533-464d-abfe-a4671cfb8698),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c540edf-72')
Nov 08 18:32:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Deleting instance files /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77_del
Nov 08 18:32:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Deletion of /opt/stack/data/nova/instances/a2eddce3-e832-4737-be16-6d6a6ba7dc77_del complete
Nov 08 18:32:20 user nova-compute[74820]: INFO nova.compute.manager [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 18:32:20 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:32:20 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:32:21 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:21 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Took 1.11 seconds to deallocate network for instance.
Nov 08 18:32:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] Acquiring lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] No waiting events found dispatching network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:22 user nova-compute[74820]: WARNING nova.compute.manager [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received unexpected event network-vif-plugged-7c540edf-72b4-4381-a2fb-48cc243f9449 for instance with vm_state deleted and task_state None.
Nov 08 18:32:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-98523c74-5324-4f2e-86c7-3ff73b3f8ee7 req-87d6442a-b0c8-450b-866c-585cde7330f0 service nova] [instance: a2eddce3-e832-4737-be16-6d6a6ba7dc77] Received event network-vif-deleted-7c540edf-72b4-4381-a2fb-48cc243f9449 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:22 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Deleted allocations for instance a2eddce3-e832-4737-be16-6d6a6ba7dc77
Nov 08 18:32:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d232e41e-45ee-4c30-a25f-2faa7b02d529 tempest-TaggedAttachmentsTest-1398852168 tempest-TaggedAttachmentsTest-1398852168-project-member] Lock "a2eddce3-e832-4737-be16-6d6a6ba7dc77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:26 user nova-compute[74820]: INFO nova.compute.manager [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Rescuing
Nov 08 18:32:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:32:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:32:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-39c354f9-09f9-4105-9a6b-674c83a5e079 req-6dca4727-d379-463c-a6b5-e4b2fbc14794 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-39c354f9-09f9-4105-9a6b-674c83a5e079 req-6dca4727-d379-463c-a6b5-e4b2fbc14794 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-39c354f9-09f9-4105-9a6b-674c83a5e079 req-6dca4727-d379-463c-a6b5-e4b2fbc14794 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-39c354f9-09f9-4105-9a6b-674c83a5e079 req-6dca4727-d379-463c-a6b5-e4b2fbc14794 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-39c354f9-09f9-4105-9a6b-674c83a5e079 req-6dca4727-d379-463c-a6b5-e4b2fbc14794 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:27 user nova-compute[74820]: WARNING nova.compute.manager [req-39c354f9-09f9-4105-9a6b-674c83a5e079 req-6dca4727-d379-463c-a6b5-e4b2fbc14794 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state active and task_state rescuing.
Nov 08 18:32:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance destroyed successfully.
Nov 08 18:32:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Attempting a stable device rescue
Nov 08 18:32:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 18:32:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:32:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Creating image(s)
Nov 08 18:32:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "/opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:28 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'trusted_certs' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "79fbb50bf770edaa61bae56619a217a527a4bfe0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "79fbb50bf770edaa61bae56619a217a527a4bfe0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG nova.virt.images [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] 84c76e26-ed9a-4bd2-8677-58af258e4cfd was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.part /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-926048f3-f181-4581-91de-c1b8383e6347 req-e00d30e8-3be7-48cb-bf17-3ea2c6ec4182 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-926048f3-f181-4581-91de-c1b8383e6347 req-e00d30e8-3be7-48cb-bf17-3ea2c6ec4182 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-926048f3-f181-4581-91de-c1b8383e6347 req-e00d30e8-3be7-48cb-bf17-3ea2c6ec4182 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-926048f3-f181-4581-91de-c1b8383e6347 req-e00d30e8-3be7-48cb-bf17-3ea2c6ec4182 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-926048f3-f181-4581-91de-c1b8383e6347 req-e00d30e8-3be7-48cb-bf17-3ea2c6ec4182 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:29 user nova-compute[74820]: WARNING nova.compute.manager [req-926048f3-f181-4581-91de-c1b8383e6347 req-e00d30e8-3be7-48cb-bf17-3ea2c6ec4182 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state active and task_state rescuing.
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.part /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.converted" returned: 0 in 0.570s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "79fbb50bf770edaa61bae56619a217a527a4bfe0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.999s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "79fbb50bf770edaa61bae56619a217a527a4bfe0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "79fbb50bf770edaa61bae56619a217a527a4bfe0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0 --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0,backing_fmt=raw /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0,backing_fmt=raw /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue" returned: 0 in 0.051s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "79fbb50bf770edaa61bae56619a217a527a4bfe0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'migration_context' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<c51df6e9-c969-4869-88be-77c877029dde> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Start _get_guest_xml network_info=[{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "vif_mac": "fa:16:3e:62:44:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '84c76e26-ed9a-4bd2-8677-58af258e4cfd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'dbd8e099-f1a4-4bbe-953a-5b823626de17', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c51df6e9-c969-4869-88be-77c877029dde', 'attached_at': '', 'detached_at': '', 'volume_id': '862b48d8-4df9-4c26-8fa4-e927ecac302b', 'serial': '862b48d8-4df9-4c26-8fa4-e927ecac302b'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'resources' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<c51df6e9-c969-4869-88be-77c877029dde> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'numa_topology' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<c51df6e9-c969-4869-88be-77c877029dde> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:32:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'vcpu_model' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<c51df6e9-c969-4869-88be-77c877029dde> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:32:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:30 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:32:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e08183-505a-4ee5-84ac-61da4922e714]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vQlnaZpK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 18:32:30 user nova-compute[74820]: node.name = iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:32:30 user nova-compute[74820]: node.tpgt = -1
Nov 08 18:32:30 user nova-compute[74820]: node.startup = automatic
Nov 08 18:32:30 user nova-compute[74820]: node.leading_login = No
Nov 08 18:32:30 user nova-compute[74820]: iface.iscsi_ifacename = default
Nov 08 18:32:30 user nova-compute[74820]: iface.net_ifacename = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.ipaddress = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.prefix_len = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.hwaddress = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.transport_name = tcp
Nov 08 18:32:30 user nova-compute[74820]: iface.initiatorname = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.vlan_id = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.vlan_priority = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.vlan_state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.iface_num = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.mtu = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.port = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.bootproto = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.subnet_mask = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.gateway = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_alt_client_id = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_dns = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_learn_iqn = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_vendor_id_state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_vendor_id = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.dhcp_slp_da = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.fragmentation = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.gratuitous_arp = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.incoming_forwarding = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.tos_state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.tos = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.ttl = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.delayed_ack = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.tcp_nagle = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.tcp_wsf_state = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.tcp_wsf = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.tcp_timer_scale = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.tcp_timestamp = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.redirect = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.def_task_mgmt_timeout = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.header_digest = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.data_digest = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.immediate_data = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.initial_r2t = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.data_seq_inorder = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.data_pdu_inorder = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.erl = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.max_receive_data_len = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.first_burst_len = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.max_outstanding_r2t = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.max_burst_len = 0
Nov 08 18:32:30 user nova-compute[74820]: iface.chap_auth = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.bidi_chap = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.strict_login_compliance = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.discovery_auth = <empty>
Nov 08 18:32:30 user nova-compute[74820]: iface.discovery_logout = <empty>
Nov 08 18:32:30 user nova-compute[74820]: node.discovery_address = <empty>
Nov 08 18:32:30 user nova-compute[74820]: node.discovery_port = 0
Nov 08 18:32:30 user nova-compute[74820]: node.discovery_type = static
Nov 08 18:32:30 user nova-compute[74820]: node.session.initial_cmdsn = 0
Nov 08 18:32:30 user nova-compute[74820]: node.session.initial_login_retry_max = 8
Nov 08 18:32:30 user nova-compute[74820]: node.session.xmit_thread_priority = -20
Nov 08 18:32:30 user nova-compute[74820]: node.session.cmds_max = 128
Nov 08 18:32:30 user nova-compute[74820]: node.session.queue_depth = 32
Nov 08 18:32:30 user nova-compute[74820]: node.session.nr_sessions = 1
Nov 08 18:32:30 user nova-compute[74820]: node.session.auth.authmethod = CHAP
Nov 08 18:32:30 user nova-compute[74820]: node.session.auth.username = vQlnaZpK
Nov 08 18:32:30 user nova-compute[74820]: node.session.auth.password = ***
Nov 08 18:32:30 user nova-compute[74820]: node.session.auth.username_in = <empty>
Nov 08 18:32:30 user nova-compute[74820]: node.session.auth.password_in = <empty>
Nov 08 18:32:30 user nova-compute[74820]: node.session.auth.chap_algs = MD5
Nov 08 18:32:30 user nova-compute[74820]: node.session.timeo.replacement_timeout = 120
Nov 08 18:32:30 user nova-compute[74820]: node.session.err_timeo.abort_timeout = 15
Nov 08 18:32:30 user nova-compute[74820]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 18:32:30 user nova-compute[74820]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 18:32:30 user nova-compute[74820]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.FastAbort = Yes
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.InitialR2T = No
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.ImmediateData = Yes
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.MaxConnections = 1
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 18:32:30 user nova-compute[74820]: node.session.iscsi.ERL = 0
Nov 08 18:32:30 user nova-compute[74820]: node.session.scan = manual
Nov 08 18:32:30 user nova-compute[74820]: node.session.reopen_max = 0
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].address = 172.16.0.220
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].port = 3260
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].startup = manual
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].tcp.window_size = 524288
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].tcp.type_of_service = 0
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].timeo.logout_timeout = 15
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].timeo.login_timeout = 15
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].timeo.auth_timeout = 45
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].iscsi.DataDigest = None
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].iscsi.IFMarker = No
Nov 08 18:32:30 user nova-compute[74820]: node.conn[0].iscsi.OFMarker = No
Nov 08 18:32:30 user nova-compute[74820]: # END RECORD
Nov 08 18:32:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d76f0-98ca-44a8-8e95-5c3a0a462017]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d122446d-45ae-418b-be23-e4c8e99c6e66]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQlnaZpK {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQlnaZpK" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b71da5-b8bb-4040-8519-c87fb6c7a8da]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQlnaZpK'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9f034-38b5-4cb9-8a03-6c99b719fa88]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc3498d-c62e-4e71-b922-0e5e3605568f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] HCTL ('35', '0', '0', 0) found on session 8 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf6e110-e4f2-49b0-b6fa-1cf4ade78796]: (4, ('0 0 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching for a device in session 8 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.213s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== connect_volume: return (215ms) {'type': 'block', 'scsi_wwn': '23435656364666433', 'path': '/dev/sdd'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435656364666433', 'path': '/dev/sdd'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281338095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281338095',id=11,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-8sr3ipkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:31:06Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=c51df6e9-c969-4869-88be-77c877029dde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "vif_mac": "fa:16:3e:62:44:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "vif_mac": "fa:16:3e:62:44:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'pci_devices' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.objects.base [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<c51df6e9-c969-4869-88be-77c877029dde> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:32:30 user nova-compute[74820]:   <uuid>c51df6e9-c969-4869-88be-77c877029dde</uuid>
Nov 08 18:32:30 user nova-compute[74820]:   <name>instance-0000000b</name>
Nov 08 18:32:30 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:32:30 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:32:30 user nova-compute[74820]:   <metadata>
Nov 08 18:32:30 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:32:30 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:32:30 user nova-compute[74820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1281338095</nova:name>
Nov 08 18:32:30 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:32:30</nova:creationTime>
Nov 08 18:32:30 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:32:30 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:32:30 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:32:30 user nova-compute[74820]:       <nova:owner>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:user uuid="c5790613f8a24f52897aedd0634f7f7f">tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member</nova:user>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:project uuid="e77a76c049904c6abe35b10929563c00">tempest-ServerBootFromVolumeStableRescueTest-516881030</nova:project>
Nov 08 18:32:30 user nova-compute[74820]:       </nova:owner>
Nov 08 18:32:30 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:32:30 user nova-compute[74820]:       <nova:ports>
Nov 08 18:32:30 user nova-compute[74820]:         <nova:port uuid="b5562326-c480-40aa-80ab-db849577b104">
Nov 08 18:32:30 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 18:32:30 user nova-compute[74820]:         </nova:port>
Nov 08 18:32:30 user nova-compute[74820]:       </nova:ports>
Nov 08 18:32:30 user nova-compute[74820]:     </nova:instance>
Nov 08 18:32:30 user nova-compute[74820]:   </metadata>
Nov 08 18:32:30 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:32:30 user nova-compute[74820]:     <system>
Nov 08 18:32:30 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:32:30 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:32:30 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:32:30 user nova-compute[74820]:       <entry name="serial">c51df6e9-c969-4869-88be-77c877029dde</entry>
Nov 08 18:32:30 user nova-compute[74820]:       <entry name="uuid">c51df6e9-c969-4869-88be-77c877029dde</entry>
Nov 08 18:32:30 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:32:30 user nova-compute[74820]:     </system>
Nov 08 18:32:30 user nova-compute[74820]:   </sysinfo>
Nov 08 18:32:30 user nova-compute[74820]:   <os>
Nov 08 18:32:30 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:32:30 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:32:30 user nova-compute[74820]:   </os>
Nov 08 18:32:30 user nova-compute[74820]:   <features>
Nov 08 18:32:30 user nova-compute[74820]:     <acpi/>
Nov 08 18:32:30 user nova-compute[74820]:     <apic/>
Nov 08 18:32:30 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:32:30 user nova-compute[74820]:   </features>
Nov 08 18:32:30 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:32:30 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:32:30 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:32:30 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:32:30 user nova-compute[74820]:   </clock>
Nov 08 18:32:30 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:32:30 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:32:30 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:32:30 user nova-compute[74820]:   </cpu>
Nov 08 18:32:30 user nova-compute[74820]:   <devices>
Nov 08 18:32:30 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:32:30 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:30 user nova-compute[74820]:       <source dev="/dev/sdd"/>
Nov 08 18:32:30 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:32:30 user nova-compute[74820]:       <serial>862b48d8-4df9-4c26-8fa4-e927ecac302b</serial>
Nov 08 18:32:30 user nova-compute[74820]:     </disk>
Nov 08 18:32:30 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:32:30 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:32:30 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue"/>
Nov 08 18:32:30 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:32:30 user nova-compute[74820]:       <boot order="1"/>
Nov 08 18:32:30 user nova-compute[74820]:     </disk>
Nov 08 18:32:30 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:32:30 user nova-compute[74820]:       <mac address="fa:16:3e:62:44:0b"/>
Nov 08 18:32:30 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:32:30 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:32:30 user nova-compute[74820]:       <target dev="tapb5562326-c4"/>
Nov 08 18:32:30 user nova-compute[74820]:     </interface>
Nov 08 18:32:30 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:32:30 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/console.log" append="off"/>
Nov 08 18:32:30 user nova-compute[74820]:     </serial>
Nov 08 18:32:30 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:32:30 user nova-compute[74820]:     <video>
Nov 08 18:32:30 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:32:30 user nova-compute[74820]:     </video>
Nov 08 18:32:30 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:32:30 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:32:30 user nova-compute[74820]:     </rng>
Nov 08 18:32:30 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:32:30 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:32:30 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:32:30 user nova-compute[74820]:     </memballoon>
Nov 08 18:32:30 user nova-compute[74820]:   </devices>
Nov 08 18:32:30 user nova-compute[74820]: </domain>
Nov 08 18:32:30 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:32:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance destroyed successfully.
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:32:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No VIF found with MAC fa:16:3e:62:44:0b, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-2ea6006e-2595-472e-9a45-3e652fe190cb req-9064a69d-43ce-4927-a7b0-abf217e65f13 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2ea6006e-2595-472e-9a45-3e652fe190cb req-9064a69d-43ce-4927-a7b0-abf217e65f13 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2ea6006e-2595-472e-9a45-3e652fe190cb req-9064a69d-43ce-4927-a7b0-abf217e65f13 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2ea6006e-2595-472e-9a45-3e652fe190cb req-9064a69d-43ce-4927-a7b0-abf217e65f13 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-2ea6006e-2595-472e-9a45-3e652fe190cb req-9064a69d-43ce-4927-a7b0-abf217e65f13 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:32 user nova-compute[74820]: WARNING nova.compute.manager [req-2ea6006e-2595-472e-9a45-3e652fe190cb req-9064a69d-43ce-4927-a7b0-abf217e65f13 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state active and task_state rescuing.
Nov 08 18:32:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-26fd3737-9140-4d94-b0e2-35bb00d6d63f req-597c9127-3fcc-4e03-aa3b-2d2a0385c5d6 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-26fd3737-9140-4d94-b0e2-35bb00d6d63f req-597c9127-3fcc-4e03-aa3b-2d2a0385c5d6 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-26fd3737-9140-4d94-b0e2-35bb00d6d63f req-597c9127-3fcc-4e03-aa3b-2d2a0385c5d6 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-26fd3737-9140-4d94-b0e2-35bb00d6d63f req-597c9127-3fcc-4e03-aa3b-2d2a0385c5d6 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-26fd3737-9140-4d94-b0e2-35bb00d6d63f req-597c9127-3fcc-4e03-aa3b-2d2a0385c5d6 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:32:34 user nova-compute[74820]: WARNING nova.compute.manager [req-26fd3737-9140-4d94-b0e2-35bb00d6d63f req-597c9127-3fcc-4e03-aa3b-2d2a0385c5d6 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state active and task_state rescuing.
Nov 08 18:32:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f010ff3d-1d9b-46bc-8b53-83cf7a6750a7 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:32:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 133d6dc8-9328-4831-a247-d655d91d32a9 is timed out.
Nov 08 18:32:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Successfully detached device vdb from instance 133d6dc8-9328-4831-a247-d655d91d32a9 from the live domain config.
Nov 08 18:32:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYmJSpbG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'c97896dc-62f2-489c-9a8a-7b83093bd1dc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:32:37 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e4142e-025a-4065-8b39-0c3400346f74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:32:37 user nova-compute[74820]: No targets found.
Nov 08 18:32:37 user nova-compute[74820]: iSNS:
Nov 08 18:32:37 user nova-compute[74820]: No targets found.
Nov 08 18:32:37 user nova-compute[74820]: STATIC:
Nov 08 18:32:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:32:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:32:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:32:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce
Nov 08 18:32:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc
Nov 08 18:32:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:32:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:32:37 user nova-compute[74820]: FIRMWARE:
Nov 08 18:32:37 user nova-compute[74820]: No targets found.
Nov 08 18:32:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:32:37 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:32:37 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c48b2-4579-44f0-b5d5-7e9a78cc2cf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c7a53-0c80-4cc2-9b14-056beafc8126]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:32:37 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:32:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e401ef400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca91b011-5da4-4baf-bc07-8ac9b84a6a8e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a4eaf1-5bff-4bb9-aa67-288ce5bad5b6]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa4e351-c1b1-485b-b526-4712c8a47013]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8290a-86f7-4910-809f-6c025830aa56]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[766158ed-2fce-4c1e-8681-1c4fd5ad5fd7]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65e6328-713f-4796-b507-6b3e4db6d8b8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260]
Nov 08 18:32:37 user nova-compute[74820]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc, portal: 172.16.0.220,3260] successful.
Nov 08 18:32:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c97896dc-62f2-489c-9a8a-7b83093bd1dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1face-4f8b-418d-be5c-7af3a472f09d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] <== disconnect_volume: return (377ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lazy-loading 'flavor' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a6aa70a-f831-42e9-8697-25037270ec42 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.495s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:32:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 3a96e438-f59b-48f9-badf-abf0baede2ee {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "c51df6e9-c969-4869-88be-77c877029dde" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "c51df6e9-c969-4869-88be-77c877029dde" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:32:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-changed-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Refreshing instance network info cache due to event network-changed-4564ddbd-d3fa-45cc-81a3-76e687daf8b6. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] Acquiring lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] Acquired lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG nova.network.neutron [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Refreshing network info cache for port 4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:48 user nova-compute[74820]: INFO nova.compute.manager [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Detaching volume 68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:32:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:32:49 user nova-compute[74820]: INFO nova.virt.block_device [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Attempting to driver detach volume 68c00436-74b0-4297-ba4f-5fbbbb70f5ca from mountpoint /dev/vdb
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'flavor' on Instance uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:32:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7602MB free_disk=25.319477081298828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Attempting to detach device vdb from instance e55b6e6b-6928-407d-b147-aa912277ec71 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:32:49 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:49 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:32:49 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:32:49 user nova-compute[74820]:   <serial>68c00436-74b0-4297-ba4f-5fbbbb70f5ca</serial>
Nov 08 18:32:49 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:32:49 user nova-compute[74820]: </disk>
Nov 08 18:32:49 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully detached device vdb from instance e55b6e6b-6928-407d-b147-aa912277ec71 from the persistent domain config.
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e55b6e6b-6928-407d-b147-aa912277ec71 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:32:49 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:49 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:32:49 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:32:49 user nova-compute[74820]:   <serial>68c00436-74b0-4297-ba4f-5fbbbb70f5ca</serial>
Nov 08 18:32:49 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:32:49 user nova-compute[74820]: </disk>
Nov 08 18:32:49 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Applying migration context for instance a19102f1-af5a-4cb1-876f-8d053abed70b as it has an incoming, in-progress migration 565bebcc-f827-4164-8740-aaa9834ba06e. Migration status is finished {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 18:32:49 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating resource usage from migration 565bebcc-f827-4164-8740-aaa9834ba06e
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updated VIF entry in instance network info cache for port 4564ddbd-d3fa-45cc-81a3-76e687daf8b6. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updating instance_info_cache with network_info: [{"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b61a5807-e29a-4209-9f45-1cb58bc188c2 req-5184cf3c-f16b-4f38-9c6d-f913c504dc6b service nova] Releasing lock "refresh_cache-42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:49 user nova-compute[74820]: INFO nova.compute.manager [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attaching volume 12e4ae67-651f-4d37-9772-31e29bf263c0 to /dev/vdb
Nov 08 18:32:49 user nova-compute[74820]: DEBUG os_brick.utils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d33d70-23de-4fc9-8ed8-81ba7c91a3b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e299804-401f-4ab6-b07a-7d1024b979ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e55b6e6b-6928-407d-b147-aa912277ec71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 133d6dc8-9328-4831-a247-d655d91d32a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Migration 565bebcc-f827-4164-8740-aaa9834ba06e is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3068b758-6553-4b73-8651-73a32d20592f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1cbb53-d835-4101-89f1-12f2f03ae83e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:32:50 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:32:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac8c54-4a59-4a82-9815-6bbf18391012]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG os_brick.utils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updating existing volume attachment record: 6d7f9d2b-c0ab-40a1-86b1-7632684fee12 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.174s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:32:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:32:52 user nova-compute[74820]: INFO nova.compute.manager [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Detaching volume 85a2198c-8a72-4030-a281-a63d318debce
Nov 08 18:32:52 user nova-compute[74820]: INFO nova.virt.block_device [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Attempting to driver detach volume 85a2198c-8a72-4030-a281-a63d318debce from mountpoint /dev/vdc
Nov 08 18:32:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Attempting to detach device vdc from instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:32:52 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:52 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:32:52 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 18:32:52 user nova-compute[74820]:   <serial>85a2198c-8a72-4030-a281-a63d318debce</serial>
Nov 08 18:32:52 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 18:32:52 user nova-compute[74820]: </disk>
Nov 08 18:32:52 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:32:52 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully detached device vdc from instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 from the persistent domain config.
Nov 08 18:32:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:32:52 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:32:52 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:32:52 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 18:32:52 user nova-compute[74820]:   <serial>85a2198c-8a72-4030-a281-a63d318debce</serial>
Nov 08 18:32:52 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 18:32:52 user nova-compute[74820]: </disk>
Nov 08 18:32:52 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:32:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating instance_info_cache with network_info: [{"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-133d6dc8-9328-4831-a247-d655d91d32a9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:32:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:32:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:06 user nova-compute[74820]: INFO nova.compute.manager [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Terminating instance
Nov 08 18:33:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:33:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-867dcd32-f7ae-464d-a711-d13fd8bcffe5 req-ccebf959-3ccc-4a18-8ad9-e0daff3dba8d service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-vif-unplugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-867dcd32-f7ae-464d-a711-d13fd8bcffe5 req-ccebf959-3ccc-4a18-8ad9-e0daff3dba8d service nova] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-867dcd32-f7ae-464d-a711-d13fd8bcffe5 req-ccebf959-3ccc-4a18-8ad9-e0daff3dba8d service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-867dcd32-f7ae-464d-a711-d13fd8bcffe5 req-ccebf959-3ccc-4a18-8ad9-e0daff3dba8d service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-867dcd32-f7ae-464d-a711-d13fd8bcffe5 req-ccebf959-3ccc-4a18-8ad9-e0daff3dba8d service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] No waiting events found dispatching network-vif-unplugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-867dcd32-f7ae-464d-a711-d13fd8bcffe5 req-ccebf959-3ccc-4a18-8ad9-e0daff3dba8d service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-vif-unplugged-6be3d780-e87b-4b09-8e2c-7faca121591b for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Instance destroyed successfully.
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lazy-loading 'resources' on Instance uuid 133d6dc8-9328-4831-a247-d655d91d32a9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1990631977',display_name='tempest-TestVolumeSwap-server-1990631977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1990631977',id=8,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzdfAC7+fCun4ikLo5SooF37IOxncJEblawTjt1TPzMHh+JskkZEgh5bjKBX8mHg3OrLXPTnJg2LHlQqncErpc1YTvNgbWQF/8vNhu4d/3CrMdSA3iZAN2K3NuGTQjgQ==',key_name='tempest-keypair-1961683100',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b51037b9fc03482290b870aed2a7300d',ramdisk_id='',reservation_id='r-mqssyy0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2056200727',owner_user_name='tempest-TestVolumeSwap-2056200727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebfb883dea294af0bf2a3981caaf076a',uuid=133d6dc8-9328-4831-a247-d655d91d32a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Converting VIF {"id": "6be3d780-e87b-4b09-8e2c-7faca121591b", "address": "fa:16:3e:ab:ac:9f", "network": {"id": "b595664d-189b-4ee9-9789-9bee2e5e640d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1593952414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b51037b9fc03482290b870aed2a7300d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be3d780-e8", "ovs_interfaceid": "6be3d780-e87b-4b09-8e2c-7faca121591b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG os_vif [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6be3d780-e8, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da4dc9b2-4cc5-43a6-adad-90d2a5de354d) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: INFO os_vif [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:9f,bridge_name='br-int',has_traffic_filtering=True,id=6be3d780-e87b-4b09-8e2c-7faca121591b,network=Network(b595664d-189b-4ee9-9789-9bee2e5e640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be3d780-e8')
Nov 08 18:33:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Deleting instance files /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9_del
Nov 08 18:33:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Deletion of /opt/stack/data/nova/instances/133d6dc8-9328-4831-a247-d655d91d32a9_del complete
Nov 08 18:33:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:07 user nova-compute[74820]: INFO nova.compute.manager [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 18:33:07 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:33:07 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-542d3775-9963-463d-a794-0da06f83a0ac req-298bfd3a-c4d3-452d-9fa9-4c81f3ae8502 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-vif-deleted-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:09 user nova-compute[74820]: INFO nova.compute.manager [req-542d3775-9963-463d-a794-0da06f83a0ac req-298bfd3a-c4d3-452d-9fa9-4c81f3ae8502 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Neutron deleted interface 6be3d780-e87b-4b09-8e2c-7faca121591b; detaching it from the instance and deleting it from the info cache
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-542d3775-9963-463d-a794-0da06f83a0ac req-298bfd3a-c4d3-452d-9fa9-4c81f3ae8502 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:09 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Took 1.54 seconds to deallocate network for instance.
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-542d3775-9963-463d-a794-0da06f83a0ac req-298bfd3a-c4d3-452d-9fa9-4c81f3ae8502 service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Detach interface failed, port_id=6be3d780-e87b-4b09-8e2c-7faca121591b, reason: Instance 133d6dc8-9328-4831-a247-d655d91d32a9 could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-4cac574c-b33b-403b-bcb4-d7ca31c9ebb6 req-cb63c821-d90d-4447-889a-cb427b70ef7e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received event network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4cac574c-b33b-403b-bcb4-d7ca31c9ebb6 req-cb63c821-d90d-4447-889a-cb427b70ef7e service nova] Acquiring lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4cac574c-b33b-403b-bcb4-d7ca31c9ebb6 req-cb63c821-d90d-4447-889a-cb427b70ef7e service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4cac574c-b33b-403b-bcb4-d7ca31c9ebb6 req-cb63c821-d90d-4447-889a-cb427b70ef7e service nova] Lock "133d6dc8-9328-4831-a247-d655d91d32a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-4cac574c-b33b-403b-bcb4-d7ca31c9ebb6 req-cb63c821-d90d-4447-889a-cb427b70ef7e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] No waiting events found dispatching network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:09 user nova-compute[74820]: WARNING nova.compute.manager [req-4cac574c-b33b-403b-bcb4-d7ca31c9ebb6 req-cb63c821-d90d-4447-889a-cb427b70ef7e service nova] [instance: 133d6dc8-9328-4831-a247-d655d91d32a9] Received unexpected event network-vif-plugged-6be3d780-e87b-4b09-8e2c-7faca121591b for instance with vm_state deleted and task_state None.
Nov 08 18:33:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:09 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Deleted allocations for instance 133d6dc8-9328-4831-a247-d655d91d32a9
Nov 08 18:33:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9aefc09-114f-46ed-a18a-0c6d764c62b0 tempest-TestVolumeSwap-2056200727 tempest-TestVolumeSwap-2056200727-project-member] Lock "133d6dc8-9328-4831-a247-d655d91d32a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.188s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:10 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e55b6e6b-6928-407d-b147-aa912277ec71 is timed out.
Nov 08 18:33:10 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully detached device vdb from instance e55b6e6b-6928-407d-b147-aa912277ec71 from the live domain config.
Nov 08 18:33:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyMenrdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:10 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e824f-c0c8-4e1c-8b27-d6be491528ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:33:10 user nova-compute[74820]: No targets found.
Nov 08 18:33:10 user nova-compute[74820]: iSNS:
Nov 08 18:33:10 user nova-compute[74820]: No targets found.
Nov 08 18:33:10 user nova-compute[74820]: STATIC:
Nov 08 18:33:10 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca
Nov 08 18:33:10 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:10 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:10 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:33:10 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:10 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:10 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:33:10 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:10 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:10 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce
Nov 08 18:33:10 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:10 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:10 user nova-compute[74820]: FIRMWARE:
Nov 08 18:33:10 user nova-compute[74820]: No targets found.
Nov 08 18:33:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:33:10 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:33:10 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c9d9d-e802-4b2f-a3b4-2029ab27cf79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[974471bb-532e-4f70-b452-70c2885138fc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:33:10 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:10 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:33:10 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:33:10 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:10 user nova-compute[74820]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca (non-flash)
Nov 08 18:33:10 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c218ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01fea5-9aa3-4096-ae5f-febfd726581a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6178dd-e1e8-4216-853d-0a4b348b7c1a]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f0f2f9-ebaa-4de3-a1b8-7af6ce5a6315]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9540aa5-d128-491b-a230-726b82e098c6]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c61bc3-8f46-44ce-8bd9-c2a07817ccb2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c635d5cf-4bd2-4665-96d0-43b9fe98b32b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260]
Nov 08 18:33:10 user nova-compute[74820]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca, portal: 172.16.0.220,3260] successful.
Nov 08 18:33:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c00436-74b0-4297-ba4f-5fbbbb70f5ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e4cbf8-257b-48fd-8e75-eb1051223466]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== disconnect_volume: return (356ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:33:11 user nova-compute[74820]: DEBUG nova.objects.instance [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-79318abb-75c9-44d2-8342-b7b890e3b5e2 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.942s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:13 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 is timed out.
Nov 08 18:33:13 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully detached device vdc from instance 1f6a8436-ae6e-4edb-8046-baccf72c6560 from the live domain config.
Nov 08 18:33:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCwXcdiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:13 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9767d191-ecb5-4f66-9e08-77ce393aa8dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:33:13 user nova-compute[74820]: No targets found.
Nov 08 18:33:13 user nova-compute[74820]: iSNS:
Nov 08 18:33:13 user nova-compute[74820]: No targets found.
Nov 08 18:33:13 user nova-compute[74820]: STATIC:
Nov 08 18:33:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:33:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:33:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:13 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce
Nov 08 18:33:13 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:13 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:13 user nova-compute[74820]: FIRMWARE:
Nov 08 18:33:13 user nova-compute[74820]: No targets found.
Nov 08 18:33:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:33:13 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:33:13 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15574267-cbd5-4440-b235-12cdcb8174a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[969ac2d6-bebf-4fc2-94b7-e0ed5f6fb9b7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:33:13 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:13 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce (non-flash)
Nov 08 18:33:13 user nova-compute[74820]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:13 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e283f3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98984353-6631-44bd-9796-b9de6f63abba]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa5d358-0b2f-4ed3-a059-1055858a33f0]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1981b1-405c-4804-b104-5e44a6d42180]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.095s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a40f8-bc20-48af-b97e-e52c3cb77054]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0068de8f-7fd2-4270-8339-1a6b6238fd4c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a677a0b-2c57-491d-bd27-c52a00aaaba9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260]
Nov 08 18:33:13 user nova-compute[74820]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce, portal: 172.16.0.220,3260] successful.
Nov 08 18:33:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a2198c-8a72-4030-a281-a63d318debce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdeda2c-a46f-4b5f-a092-d0e732dd1a64]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] <== disconnect_volume: return (404ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:33:14 user nova-compute[74820]: INFO nova.compute.claims [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Claim successful on node user
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.objects.instance [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'flavor' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-858ce4ae-dcb8-470b-a577-cd7099a4cc97 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.207s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.policy [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aca49e4870243f1a18a42054edde453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e940b0e1c9024ff79a1f32133f0865b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:33:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Creating image(s)
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "/opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "/opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "/opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.226s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk 1073741824" returned: 0 in 0.057s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Successfully created port: c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Cannot resize image /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Ensure instance console log exists: /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Successfully updated port: c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-changed-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Refreshing instance network info cache due to event network-changed-c525187e-1024-4d85-9df9-4994592c71e2. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] Acquiring lock "refresh_cache-94bf2982-61c7-41a3-9aeb-3cc34cd3111b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] Acquired lock "refresh_cache-94bf2982-61c7-41a3-9aeb-3cc34cd3111b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Refreshing network info cache for port c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "refresh_cache-94bf2982-61c7-41a3-9aeb-3cc34cd3111b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-62591ae5-e77b-4f39-b907-43ec80b1b478 req-dfb86696-eee7-402a-a61f-e99fca42a1d3 service nova] Releasing lock "refresh_cache-94bf2982-61c7-41a3-9aeb-3cc34cd3111b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquired lock "refresh_cache-94bf2982-61c7-41a3-9aeb-3cc34cd3111b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:33:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Updating instance_info_cache with network_info: [{"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Releasing lock "refresh_cache-94bf2982-61c7-41a3-9aeb-3cc34cd3111b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Instance network_info: |[{"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Start _get_guest_xml network_info=[{"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:33:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:33:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-468023194',display_name='tempest-DeleteServersTestJSON-server-468023194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-468023194',id=16,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e940b0e1c9024ff79a1f32133f0865b6',ramdisk_id='',reservation_id='r-bg092gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-396242315',owner_user_name='tempest-DeleteServersTestJSON-396242315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:15Z,user_data=None,user_id='9aca49e4870243f1a18a42054edde453',uuid=94bf2982-61c7-41a3-9aeb-3cc34cd3111b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Converting VIF {"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lazy-loading 'pci_devices' on Instance uuid 94bf2982-61c7-41a3-9aeb-3cc34cd3111b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:33:17 user nova-compute[74820]:   <uuid>94bf2982-61c7-41a3-9aeb-3cc34cd3111b</uuid>
Nov 08 18:33:17 user nova-compute[74820]:   <name>instance-00000010</name>
Nov 08 18:33:17 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:33:17 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:33:17 user nova-compute[74820]:   <metadata>
Nov 08 18:33:17 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:33:17 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:33:17 user nova-compute[74820]:       <nova:name>tempest-DeleteServersTestJSON-server-468023194</nova:name>
Nov 08 18:33:17 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:33:17</nova:creationTime>
Nov 08 18:33:17 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:33:17 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:33:17 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:33:17 user nova-compute[74820]:       <nova:owner>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:user uuid="9aca49e4870243f1a18a42054edde453">tempest-DeleteServersTestJSON-396242315-project-member</nova:user>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:project uuid="e940b0e1c9024ff79a1f32133f0865b6">tempest-DeleteServersTestJSON-396242315</nova:project>
Nov 08 18:33:17 user nova-compute[74820]:       </nova:owner>
Nov 08 18:33:17 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:33:17 user nova-compute[74820]:       <nova:ports>
Nov 08 18:33:17 user nova-compute[74820]:         <nova:port uuid="c525187e-1024-4d85-9df9-4994592c71e2">
Nov 08 18:33:17 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:33:17 user nova-compute[74820]:         </nova:port>
Nov 08 18:33:17 user nova-compute[74820]:       </nova:ports>
Nov 08 18:33:17 user nova-compute[74820]:     </nova:instance>
Nov 08 18:33:17 user nova-compute[74820]:   </metadata>
Nov 08 18:33:17 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:33:17 user nova-compute[74820]:     <system>
Nov 08 18:33:17 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:33:17 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:33:17 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:33:17 user nova-compute[74820]:       <entry name="serial">94bf2982-61c7-41a3-9aeb-3cc34cd3111b</entry>
Nov 08 18:33:17 user nova-compute[74820]:       <entry name="uuid">94bf2982-61c7-41a3-9aeb-3cc34cd3111b</entry>
Nov 08 18:33:17 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:33:17 user nova-compute[74820]:     </system>
Nov 08 18:33:17 user nova-compute[74820]:   </sysinfo>
Nov 08 18:33:17 user nova-compute[74820]:   <os>
Nov 08 18:33:17 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:33:17 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:33:17 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:33:17 user nova-compute[74820]:   </os>
Nov 08 18:33:17 user nova-compute[74820]:   <features>
Nov 08 18:33:17 user nova-compute[74820]:     <acpi/>
Nov 08 18:33:17 user nova-compute[74820]:     <apic/>
Nov 08 18:33:17 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:33:17 user nova-compute[74820]:   </features>
Nov 08 18:33:17 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:33:17 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:33:17 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:33:17 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:33:17 user nova-compute[74820]:   </clock>
Nov 08 18:33:17 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:33:17 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:33:17 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:33:17 user nova-compute[74820]:   </cpu>
Nov 08 18:33:17 user nova-compute[74820]:   <devices>
Nov 08 18:33:17 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:33:17 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:33:17 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk"/>
Nov 08 18:33:17 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:33:17 user nova-compute[74820]:     </disk>
Nov 08 18:33:17 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:33:17 user nova-compute[74820]:       <mac address="fa:16:3e:cc:9c:8b"/>
Nov 08 18:33:17 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:33:17 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:33:17 user nova-compute[74820]:       <target dev="tapc525187e-10"/>
Nov 08 18:33:17 user nova-compute[74820]:     </interface>
Nov 08 18:33:17 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:33:17 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/console.log" append="off"/>
Nov 08 18:33:17 user nova-compute[74820]:     </serial>
Nov 08 18:33:17 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:33:17 user nova-compute[74820]:     <video>
Nov 08 18:33:17 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:33:17 user nova-compute[74820]:     </video>
Nov 08 18:33:17 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:33:17 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:33:17 user nova-compute[74820]:     </rng>
Nov 08 18:33:17 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:33:17 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:33:17 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:33:17 user nova-compute[74820]:     </memballoon>
Nov 08 18:33:17 user nova-compute[74820]:   </devices>
Nov 08 18:33:17 user nova-compute[74820]: </domain>
Nov 08 18:33:17 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-468023194',display_name='tempest-DeleteServersTestJSON-server-468023194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-468023194',id=16,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e940b0e1c9024ff79a1f32133f0865b6',ramdisk_id='',reservation_id='r-bg092gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-396242315',owner_user_name='tempest-DeleteServersTestJSON-396242315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:15Z,user_data=None,user_id='9aca49e4870243f1a18a42054edde453',uuid=94bf2982-61c7-41a3-9aeb-3cc34cd3111b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Converting VIF {"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG os_vif [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a83cdc20-1cb0-551e-8027-d4f4cd67d290', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc525187e-10, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc525187e-10, col_values=(('qos', UUID('7a07055c-1a1d-4246-98b4-2274ee1e6390')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc525187e-10, col_values=(('external_ids', {'iface-id': 'c525187e-1024-4d85-9df9-4994592c71e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:9c:8b', 'vm-uuid': '94bf2982-61c7-41a3-9aeb-3cc34cd3111b'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:17 user nova-compute[74820]: INFO os_vif [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10')
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] No VIF found with MAC fa:16:3e:cc:9c:8b, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:33:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:18 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:18 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:18 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a9fe26-c282-4267-9524-01d3e2bb9fcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:33:18 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e44f4bb-3608-4289-ab39-7e67d0012c75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0] added
Nov 08 18:33:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2164e41-e388-4224-b6d5-29b5a98a8899]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0327162c-04df-4624-b0d7-40da618467e1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvlOPApb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvlOPApb" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[123d9940-f0da-49c8-8c74-f7c755871240]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvlOPApb'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16fc26f-752b-4b8e-92ad-aab008a80a43]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[334369ec-cce3-450b-b7fd-7fbc73de9c34]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:18 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:18 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[39644bf0-514f-45ed-9ab9-4d383bb4b60a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]
Nov 08 18:33:18 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.
Nov 08 18:33:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4425163-0000-43ca-9712-35cfc2b04b7a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dec64a-9409-4754-a682-4f60c65d28b6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:18 user nova-compute[74820]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:33:18 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:18 user nova-compute[74820]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:33:18 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1dcf3-8b90-489f-9c6f-7621fb898014]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:33:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-63b921d9-76cb-4bdc-b778-1c886ebe7633 req-b076e425-b98b-456b-a892-5bd4a4700848 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63b921d9-76cb-4bdc-b778-1c886ebe7633 req-b076e425-b98b-456b-a892-5bd4a4700848 service nova] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63b921d9-76cb-4bdc-b778-1c886ebe7633 req-b076e425-b98b-456b-a892-5bd4a4700848 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-63b921d9-76cb-4bdc-b778-1c886ebe7633 req-b076e425-b98b-456b-a892-5bd4a4700848 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-63b921d9-76cb-4bdc-b778-1c886ebe7633 req-b076e425-b98b-456b-a892-5bd4a4700848 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] No waiting events found dispatching network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:19 user nova-compute[74820]: WARNING nova.compute.manager [req-63b921d9-76cb-4bdc-b778-1c886ebe7633 req-b076e425-b98b-456b-a892-5bd4a4700848 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received unexpected event network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 for instance with vm_state building and task_state spawning.
Nov 08 18:33:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26138386232376239', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138386232376239', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'flavor' on Instance uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:33:19 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:33:19 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:33:19 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:33:19 user nova-compute[74820]:   <serial>12e4ae67-651f-4d37-9772-31e29bf263c0</serial>
Nov 08 18:33:19 user nova-compute[74820]: </disk>
Nov 08 18:33:19 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:33:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:33:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No VIF found with MAC fa:16:3e:92:ce:7a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:33:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2434093f-6dec-4847-91d1-c69a54e9dcf0 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.543s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "d59095c8-d793-4257-a980-63be74e48c7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:33:21 user nova-compute[74820]: INFO nova.compute.manager [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Rebuilding instance
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:33:21 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Instance spawned successfully.
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-04967b20-5841-4503-893e-25f9b1eb364e req-098f29e2-b856-4fc4-ade2-83081d37fb00 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-04967b20-5841-4503-893e-25f9b1eb364e req-098f29e2-b856-4fc4-ade2-83081d37fb00 service nova] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-04967b20-5841-4503-893e-25f9b1eb364e req-098f29e2-b856-4fc4-ade2-83081d37fb00 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-04967b20-5841-4503-893e-25f9b1eb364e req-098f29e2-b856-4fc4-ade2-83081d37fb00 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-04967b20-5841-4503-893e-25f9b1eb364e req-098f29e2-b856-4fc4-ade2-83081d37fb00 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] No waiting events found dispatching network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:21 user nova-compute[74820]: WARNING nova.compute.manager [req-04967b20-5841-4503-893e-25f9b1eb364e req-098f29e2-b856-4fc4-ade2-83081d37fb00 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received unexpected event network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 for instance with vm_state building and task_state spawning.
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:33:21 user nova-compute[74820]: INFO nova.compute.claims [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Claim successful on node user
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:33:21 user nova-compute[74820]: INFO nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 08 18:33:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:21 user nova-compute[74820]: INFO nova.compute.manager [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Took 7.61 seconds to build instance.
Nov 08 18:33:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-51ce6039-5125-4b10-9d4d-6abdeb62dd60 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.768s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:33:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:33:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance destroyed successfully.
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.policy [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da2d9ad108da46cca9b8c5d870e8076d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d2eda9ff724b288680a1ac55e667ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:33:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Creating image(s)
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "/opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "/opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "/opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:22 user nova-compute[74820]: INFO nova.compute.manager [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Detaching volume 12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Port 85125f2a-e0c8-4893-8e27-7036ee1bb847 binding to destination host user is already ACTIVE {{(pid=74820) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:33:22 user nova-compute[74820]: INFO nova.virt.block_device [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attempting to driver detach volume 12e4ae67-651f-4d37-9772-31e29bf263c0 from mountpoint /dev/vdb
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Attempting to detach device vdb from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:33:22 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:33:22 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:33:22 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:33:22 user nova-compute[74820]:   <serial>12e4ae67-651f-4d37-9772-31e29bf263c0</serial>
Nov 08 18:33:22 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:33:22 user nova-compute[74820]: </disk>
Nov 08 18:33:22 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:33:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully detached device vdb from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f from the persistent domain config.
Nov 08 18:33:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:22 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cfa80-ce2e-4fb5-b9f6-86a32dd0184c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.243s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:33:22 user nova-compute[74820]: No targets found.
Nov 08 18:33:22 user nova-compute[74820]: iSNS:
Nov 08 18:33:22 user nova-compute[74820]: No targets found.
Nov 08 18:33:22 user nova-compute[74820]: STATIC:
Nov 08 18:33:22 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:33:22 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:22 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:22 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:33:22 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:22 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:22 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:33:22 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:22 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:22 user nova-compute[74820]: FIRMWARE:
Nov 08 18:33:22 user nova-compute[74820]: No targets found.
Nov 08 18:33:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:33:22 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:33:22 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbf397f-dd93-4666-b397-bb207785db63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8b168-fbfe-4198-894b-968c9a2452e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:22 user nova-compute[74820]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:33:22 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:22 user nova-compute[74820]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:33:22 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2822cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b17efe-234f-4c44-aa16-582ea1a8d9a3]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e80ed2b-98bd-4111-91e2-ad5fca0d3bb3]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bd4a86-42d8-4105-a9a4-910ba7e76b90]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:33:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d548f838-5552-4c1f-a50d-0c72104b04e0]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40748e4f-063c-450e-a05d-78030251d5c9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.248s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk 1073741824" returned: 0 in 0.071s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceb0f8e-753e-46df-8c83-6a6b5a2a13fa]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]
Nov 08 18:33:23 user nova-compute[74820]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.
Nov 08 18:33:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b119345c-8764-45f8-ba7d-cbd350381a6b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== disconnect_volume: return (466ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Creating tmpfile /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/tmpolyeyhos to verify with other compute node that the instance is on the same shared storage. {{(pid=74820) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.236s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Cannot resize image /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Ensure instance console log exists: /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Successfully created port: 8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-7f9145c4-c733-4f6a-bdc0-f363e6520b75 req-4cb10d7a-6675-404c-af3a-1bf2bc09318a service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7f9145c4-c733-4f6a-bdc0-f363e6520b75 req-4cb10d7a-6675-404c-af3a-1bf2bc09318a service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7f9145c4-c733-4f6a-bdc0-f363e6520b75 req-4cb10d7a-6675-404c-af3a-1bf2bc09318a service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7f9145c4-c733-4f6a-bdc0-f363e6520b75 req-4cb10d7a-6675-404c-af3a-1bf2bc09318a service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-7f9145c4-c733-4f6a-bdc0-f363e6520b75 req-4cb10d7a-6675-404c-af3a-1bf2bc09318a service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:23 user nova-compute[74820]: WARNING nova.compute.manager [req-7f9145c4-c733-4f6a-bdc0-f363e6520b75 req-4cb10d7a-6675-404c-af3a-1bf2bc09318a service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state resized and task_state resize_reverting.
Nov 08 18:33:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance destroyed successfully.
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'resources' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85125f2a-e0, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7e372ec-356a-41f7-bc5b-0bfddb60ee91) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: INFO os_vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0')
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:24 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a3c99-a7dd-4180-befe-a6e3d2de485d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:33:24 user nova-compute[74820]: No targets found.
Nov 08 18:33:24 user nova-compute[74820]: iSNS:
Nov 08 18:33:24 user nova-compute[74820]: No targets found.
Nov 08 18:33:24 user nova-compute[74820]: STATIC:
Nov 08 18:33:24 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:33:24 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:24 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:24 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:33:24 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:24 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:24 user nova-compute[74820]: FIRMWARE:
Nov 08 18:33:24 user nova-compute[74820]: No targets found.
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:33:24 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:33:24 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[51387aa2-a1c5-4e45-ad8e-a0ab99345a78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1640c474-fa56-4ed6-9ad5-a8422c9db0a5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:24 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:33:24 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e282e9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c'): ({'sdg'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Removing single pathed devices sdg {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadcc72b-66cc-4f4c-b646-973e2e0507d8]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08affa-90d5-4aa7-aa33-05f79d6a6f55]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flushing IO for device /dev/sdg {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013738d-7343-48aa-ad2f-ee7099607d77]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-b3dbb5a0-ed9a-4afc-9fff-af01f4ba9ee7 req-da6f4754-8efc-4a74-b9e5-5c9904954918 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-unplugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b3dbb5a0-ed9a-4afc-9fff-af01f4ba9ee7 req-da6f4754-8efc-4a74-b9e5-5c9904954918 service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b3dbb5a0-ed9a-4afc-9fff-af01f4ba9ee7 req-da6f4754-8efc-4a74-b9e5-5c9904954918 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b3dbb5a0-ed9a-4afc-9fff-af01f4ba9ee7 req-da6f4754-8efc-4a74-b9e5-5c9904954918 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-b3dbb5a0-ed9a-4afc-9fff-af01f4ba9ee7 req-da6f4754-8efc-4a74-b9e5-5c9904954918 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-unplugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:24 user nova-compute[74820]: WARNING nova.compute.manager [req-b3dbb5a0-ed9a-4afc-9fff-af01f4ba9ee7 req-da6f4754-8efc-4a74-b9e5-5c9904954918 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-unplugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state active and task_state rebuilding.
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[58597bf2-5e1d-4b04-83bd-2c50d7781ecc]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] SCSI volumes sdg have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ad4bf-6c50-444e-a366-da5304fe604c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[471e4f6d-dec1-4070-b200-c8ea9c656b6f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]
Nov 08 18:33:24 user nova-compute[74820]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6016e8cf-0b16-4759-b596-d7d4638f27fc]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== disconnect_volume: return (392ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Successfully updated port: 8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquired lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:33:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance destroyed successfully.
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-674409609',display_name='tempest-ServerActionsTestOtherA-server-2011474520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-674409609',id=14,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOyJSZaNwBdRj1hWE7uv2aBJY3g3C1v/eMFBUqPoGZMPW+a7ET03xsrCvH7D3VLG92nqRTg+wE3xk+rVA03MMCw0PZt/WhLbrYFQrzWlgDZ9P1DrK6EcLhnLTDNNa1HQA==',key_name='tempest-keypair-1672348396',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:31:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-8rmn5v7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=42d369f9-f38b-4ddf-acb7-72f3f54f7f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4564ddbd-d3, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc5b0fdf-0c62-4c24-9367-e326742c5feb) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:24 user nova-compute[74820]: INFO os_vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3')
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:24 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee5d63-9d2a-4979-b7aa-e09a2678a599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:33:24 user nova-compute[74820]: No targets found.
Nov 08 18:33:24 user nova-compute[74820]: iSNS:
Nov 08 18:33:24 user nova-compute[74820]: No targets found.
Nov 08 18:33:24 user nova-compute[74820]: STATIC:
Nov 08 18:33:24 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:33:24 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:33:24 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:33:24 user nova-compute[74820]: FIRMWARE:
Nov 08 18:33:24 user nova-compute[74820]: No targets found.
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:33:24 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:33:24 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aababee3-d05c-49eb-9989-07afd3bbe9c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd90129-b126-4bad-96fb-6c1371c7e9bf]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2822e560>, {}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Disconnecting from: [] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== disconnect_volume: return (80ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:33:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Deleting instance files /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f_del
Nov 08 18:33:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Deletion of /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f_del complete
Nov 08 18:33:25 user nova-compute[74820]: INFO nova.virt.block_device [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Booting with volume 12e4ae67-651f-4d37-9772-31e29bf263c0 at /dev/vdb
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updating instance_info_cache with network_info: [{"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Releasing lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Instance network_info: |[{"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Start _get_guest_xml network_info=[{"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_brick.utils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:33:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1977219225',display_name='tempest-ServersNegativeTestJSON-server-1977219225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1977219225',id=17,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16d2eda9ff724b288680a1ac55e667ce',ramdisk_id='',reservation_id='r-e4fyhvpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-816870962',owner_user_name='tempest-ServersNegativeTestJSON-816870962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:22Z,user_data=None,user_id='da2d9ad108da46cca9b8c5d870e8076d',uuid=d59095c8-d793-4257-a980-63be74e48c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converting VIF {"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lazy-loading 'pci_devices' on Instance uuid d59095c8-d793-4257-a980-63be74e48c7a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7b237c-e912-41c6-87e6-1a74d0b8f831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:33:25 user nova-compute[74820]:   <uuid>d59095c8-d793-4257-a980-63be74e48c7a</uuid>
Nov 08 18:33:25 user nova-compute[74820]:   <name>instance-00000011</name>
Nov 08 18:33:25 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:33:25 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:33:25 user nova-compute[74820]:   <metadata>
Nov 08 18:33:25 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:33:25 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:33:25 user nova-compute[74820]:       <nova:name>tempest-ServersNegativeTestJSON-server-1977219225</nova:name>
Nov 08 18:33:25 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:33:25</nova:creationTime>
Nov 08 18:33:25 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:33:25 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:33:25 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:33:25 user nova-compute[74820]:       <nova:owner>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:user uuid="da2d9ad108da46cca9b8c5d870e8076d">tempest-ServersNegativeTestJSON-816870962-project-member</nova:user>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:project uuid="16d2eda9ff724b288680a1ac55e667ce">tempest-ServersNegativeTestJSON-816870962</nova:project>
Nov 08 18:33:25 user nova-compute[74820]:       </nova:owner>
Nov 08 18:33:25 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:33:25 user nova-compute[74820]:       <nova:ports>
Nov 08 18:33:25 user nova-compute[74820]:         <nova:port uuid="8530850e-e922-4941-bc82-4c4b85a7eb4c">
Nov 08 18:33:25 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:33:25 user nova-compute[74820]:         </nova:port>
Nov 08 18:33:25 user nova-compute[74820]:       </nova:ports>
Nov 08 18:33:25 user nova-compute[74820]:     </nova:instance>
Nov 08 18:33:25 user nova-compute[74820]:   </metadata>
Nov 08 18:33:25 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:33:25 user nova-compute[74820]:     <system>
Nov 08 18:33:25 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:33:25 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:33:25 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:33:25 user nova-compute[74820]:       <entry name="serial">d59095c8-d793-4257-a980-63be74e48c7a</entry>
Nov 08 18:33:25 user nova-compute[74820]:       <entry name="uuid">d59095c8-d793-4257-a980-63be74e48c7a</entry>
Nov 08 18:33:25 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:33:25 user nova-compute[74820]:     </system>
Nov 08 18:33:25 user nova-compute[74820]:   </sysinfo>
Nov 08 18:33:25 user nova-compute[74820]:   <os>
Nov 08 18:33:25 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:33:25 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:33:25 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:33:25 user nova-compute[74820]:   </os>
Nov 08 18:33:25 user nova-compute[74820]:   <features>
Nov 08 18:33:25 user nova-compute[74820]:     <acpi/>
Nov 08 18:33:25 user nova-compute[74820]:     <apic/>
Nov 08 18:33:25 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:33:25 user nova-compute[74820]:   </features>
Nov 08 18:33:25 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:33:25 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:33:25 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:33:25 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:33:25 user nova-compute[74820]:   </clock>
Nov 08 18:33:25 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:33:25 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:33:25 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:33:25 user nova-compute[74820]:   </cpu>
Nov 08 18:33:25 user nova-compute[74820]:   <devices>
Nov 08 18:33:25 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:33:25 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:33:25 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk"/>
Nov 08 18:33:25 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:33:25 user nova-compute[74820]:     </disk>
Nov 08 18:33:25 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:33:25 user nova-compute[74820]:       <mac address="fa:16:3e:4e:e4:68"/>
Nov 08 18:33:25 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:33:25 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:33:25 user nova-compute[74820]:       <target dev="tap8530850e-e9"/>
Nov 08 18:33:25 user nova-compute[74820]:     </interface>
Nov 08 18:33:25 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:33:25 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/console.log" append="off"/>
Nov 08 18:33:25 user nova-compute[74820]:     </serial>
Nov 08 18:33:25 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:33:25 user nova-compute[74820]:     <video>
Nov 08 18:33:25 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:33:25 user nova-compute[74820]:     </video>
Nov 08 18:33:25 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:33:25 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:33:25 user nova-compute[74820]:     </rng>
Nov 08 18:33:25 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:33:25 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:33:25 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:33:25 user nova-compute[74820]:     </memballoon>
Nov 08 18:33:25 user nova-compute[74820]:   </devices>
Nov 08 18:33:25 user nova-compute[74820]: </domain>
Nov 08 18:33:25 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1977219225',display_name='tempest-ServersNegativeTestJSON-server-1977219225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1977219225',id=17,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16d2eda9ff724b288680a1ac55e667ce',ramdisk_id='',reservation_id='r-e4fyhvpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-816870962',owner_user_name='tempest-ServersNegativeTestJSON-816870962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:22Z,user_data=None,user_id='da2d9ad108da46cca9b8c5d870e8076d',uuid=d59095c8-d793-4257-a980-63be74e48c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converting VIF {"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_vif [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e423025c-0e36-5b34-8adc-54a20d7a62de', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[883bd5b1-53fe-4002-8814-cdeb84ff260a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8530850e-e9, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8530850e-e9, col_values=(('qos', UUID('4a16d543-b266-4193-8d64-e128068057df')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8530850e-e9, col_values=(('external_ids', {'iface-id': '8530850e-e922-4941-bc82-4c4b85a7eb4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:e4:68', 'vm-uuid': 'd59095c8-d793-4257-a980-63be74e48c7a'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:25 user nova-compute[74820]: INFO os_vif [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9')
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e0f2c2-e280-41ae-a354-1e38b1cb207f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc40bef-7b36-4afa-bb3c-eb05f060cdb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:33:25 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56613ac-4ef0-4313-8b0c-8f3fccf48e60]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG os_brick.utils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updating existing volume attachment record: 7342ead2-59e6-4e02-ae1a-24a2ab1540fd {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] No VIF found with MAC fa:16:3e:4e:e4:68, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:25 user nova-compute[74820]: WARNING nova.compute.manager [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state resized and task_state resize_reverting.
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-changed-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Refreshing instance network info cache due to event network-changed-8530850e-e922-4941-bc82-4c4b85a7eb4c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] Acquiring lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] Acquired lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Refreshing network info cache for port 8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'migration_context' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:25 user nova-compute[74820]: DEBUG nova.objects.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Object Instance<a19102f1-af5a-4cb1-876f-8d053abed70b> lazy-loaded attributes: resources,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.network.neutron [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updated VIF entry in instance network info cache for port 8530850e-e922-4941-bc82-4c4b85a7eb4c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.network.neutron [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updating instance_info_cache with network_info: [{"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-816ec044-7eba-4f54-ae7d-9b0cf84cbf22 req-d690d36e-4f90-4a1b-b625-e6df5bf5bdca service nova] Releasing lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.518s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef678554-ab4e-481b-9fcf-7cfe0d8780e5 req-1f919462-7e97-4946-96e2-3f0645acd1c6 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef678554-ab4e-481b-9fcf-7cfe0d8780e5 req-1f919462-7e97-4946-96e2-3f0645acd1c6 service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef678554-ab4e-481b-9fcf-7cfe0d8780e5 req-1f919462-7e97-4946-96e2-3f0645acd1c6 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef678554-ab4e-481b-9fcf-7cfe0d8780e5 req-1f919462-7e97-4946-96e2-3f0645acd1c6 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef678554-ab4e-481b-9fcf-7cfe0d8780e5 req-1f919462-7e97-4946-96e2-3f0645acd1c6 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:26 user nova-compute[74820]: WARNING nova.compute.manager [req-ef678554-ab4e-481b-9fcf-7cfe0d8780e5 req-1f919462-7e97-4946-96e2-3f0645acd1c6 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 08 18:33:26 user nova-compute[74820]: INFO nova.compute.manager [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Swapping old allocation on dict_keys(['b6dd5339-b9ae-45ca-86de-93315b7f0863']) held by migration 565bebcc-f827-4164-8740-aaa9834ba06e for instance
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Overwriting current allocation {'allocations': {'b6dd5339-b9ae-45ca-86de-93315b7f0863': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 22}}, 'project_id': 'e230a1c67e924522b88cfc57decccb17', 'user_id': '8d7a66f28dd1417980df3a2f3a64bc0e', 'consumer_generation': 1} on consumer a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:33:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG os_brick.utils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7eb79c-8bb0-4736-bf9d-bfc9e52a9426]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a2f59f-451d-43e1-8f69-fa7f3994f4cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ca4d2-2fe0-40ad-a3a9-05bee501f463]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee81220-6e85-4742-bc52-683e6e9a82c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:33:28 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e72d0f-86dd-4d0b-8e23-aac769fecf51]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG os_brick.utils [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] No waiting events found dispatching network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:28 user nova-compute[74820]: WARNING nova.compute.manager [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received unexpected event network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c for instance with vm_state building and task_state spawning.
Nov 08 18:33:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] No waiting events found dispatching network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:28 user nova-compute[74820]: WARNING nova.compute.manager [req-692015be-c297-45a5-bf42-dd6c8193f7dd req-fcc19ac5-6465-47c2-a9d4-d25ace931707 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received unexpected event network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c for instance with vm_state building and task_state spawning.
Nov 08 18:33:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:33:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Instance spawned successfully.
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:30 user nova-compute[74820]: INFO nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 08 18:33:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:33:30 user nova-compute[74820]: INFO nova.compute.manager [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Took 9.07 seconds to build instance.
Nov 08 18:33:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f35d0b4f-ff2d-4955-b2ab-7e039740a78f tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "d59095c8-d793-4257-a980-63be74e48c7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.227s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:39 user nova-compute[74820]: INFO nova.compute.manager [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Terminating instance
Nov 08 18:33:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-9658a226-78b3-4513-bf86-5af1080a39b2 req-70c569e7-7084-48b6-a61a-d04001584051 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-vif-unplugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9658a226-78b3-4513-bf86-5af1080a39b2 req-70c569e7-7084-48b6-a61a-d04001584051 service nova] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9658a226-78b3-4513-bf86-5af1080a39b2 req-70c569e7-7084-48b6-a61a-d04001584051 service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9658a226-78b3-4513-bf86-5af1080a39b2 req-70c569e7-7084-48b6-a61a-d04001584051 service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-9658a226-78b3-4513-bf86-5af1080a39b2 req-70c569e7-7084-48b6-a61a-d04001584051 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] No waiting events found dispatching network-vif-unplugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-9658a226-78b3-4513-bf86-5af1080a39b2 req-70c569e7-7084-48b6-a61a-d04001584051 service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-vif-unplugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:33:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Instance destroyed successfully.
Nov 08 18:33:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'resources' on Instance uuid e55b6e6b-6928-407d-b147-aa912277ec71 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1037311916',display_name='tempest-AttachVolumeNegativeTest-server-1037311916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1037311916',id=4,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH63lXMeaDeAhRD1NTC7hyfSsYdQhE+1JMRONrstAd+7dj1mGLZrSv6JMcVjlG2zErGREK1lwXVoEzS9dZNN4AeziE030XZuhJJgAQ+kY9Ue1ERBrSsvGE1AbLuHvSv09Q==',key_name='tempest-keypair-2003508355',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-0urs701a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=e55b6e6b-6928-407d-b147-aa912277ec71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "address": "fa:16:3e:28:1d:78", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f05462e-3c", "ovs_interfaceid": "4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG os_vif [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f05462e-3c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fbce8ff-4ef6-41a4-b32d-05ed13cb1a4d) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:40 user nova-compute[74820]: INFO os_vif [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1d:78,bridge_name='br-int',has_traffic_filtering=True,id=4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f05462e-3c')
Nov 08 18:33:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Deleting instance files /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71_del
Nov 08 18:33:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Deletion of /opt/stack/data/nova/instances/e55b6e6b-6928-407d-b147-aa912277ec71_del complete
Nov 08 18:33:40 user nova-compute[74820]: INFO nova.compute.manager [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 18:33:40 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:33:40 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:41 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Took 1.09 seconds to deallocate network for instance.
Nov 08 18:33:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-827dd3e2-a130-4512-b905-94c2176aa789 req-b808b8f4-9a53-4d5e-80b3-ed66adecf54d service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-vif-deleted-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-e2882d09-5f95-4129-b785-770536950cb2 req-12b9ffeb-0037-4949-b2ce-0294c9d24e2e service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received event network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e2882d09-5f95-4129-b785-770536950cb2 req-12b9ffeb-0037-4949-b2ce-0294c9d24e2e service nova] Acquiring lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e2882d09-5f95-4129-b785-770536950cb2 req-12b9ffeb-0037-4949-b2ce-0294c9d24e2e service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e2882d09-5f95-4129-b785-770536950cb2 req-12b9ffeb-0037-4949-b2ce-0294c9d24e2e service nova] Lock "e55b6e6b-6928-407d-b147-aa912277ec71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-e2882d09-5f95-4129-b785-770536950cb2 req-12b9ffeb-0037-4949-b2ce-0294c9d24e2e service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] No waiting events found dispatching network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:41 user nova-compute[74820]: WARNING nova.compute.manager [req-e2882d09-5f95-4129-b785-770536950cb2 req-12b9ffeb-0037-4949-b2ce-0294c9d24e2e service nova] [instance: e55b6e6b-6928-407d-b147-aa912277ec71] Received unexpected event network-vif-plugged-4f05462e-3cb3-4b2d-ab29-12f8fde5aa4c for instance with vm_state deleted and task_state None.
Nov 08 18:33:41 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:41 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Deleted allocations for instance e55b6e6b-6928-407d-b147-aa912277ec71
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c133e990-0ffa-43a8-92fa-f765984e02bb tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "e55b6e6b-6928-407d-b147-aa912277ec71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.787s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:42 user nova-compute[74820]: INFO nova.compute.manager [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Terminating instance
Nov 08 18:33:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.compute.manager [req-d18f1801-bc7e-4136-9c05-ae5ef9e7652a req-5949eb88-1d95-412c-ac82-849ff1243dc5 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-unplugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d18f1801-bc7e-4136-9c05-ae5ef9e7652a req-5949eb88-1d95-412c-ac82-849ff1243dc5 service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d18f1801-bc7e-4136-9c05-ae5ef9e7652a req-5949eb88-1d95-412c-ac82-849ff1243dc5 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d18f1801-bc7e-4136-9c05-ae5ef9e7652a req-5949eb88-1d95-412c-ac82-849ff1243dc5 service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.compute.manager [req-d18f1801-bc7e-4136-9c05-ae5ef9e7652a req-5949eb88-1d95-412c-ac82-849ff1243dc5 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-unplugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.compute.manager [req-d18f1801-bc7e-4136-9c05-ae5ef9e7652a req-5949eb88-1d95-412c-ac82-849ff1243dc5 service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-unplugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Instance destroyed successfully.
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.objects.instance [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'resources' on Instance uuid 1f6a8436-ae6e-4edb-8046-baccf72c6560 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2024314283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2024314283',id=3,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg5ezgL7fDWQ0j/n0PZICZmy/N40SmvarZlg0lwj9ZxwPwrOi0ct8zDukLJqKXjIKyOJTAldRJwsA3bHrOhRGpdv9w2rDG4gi4E5jjouezEz1BjOl1yccMqb2+N4CIaEQ==',key_name='tempest-keypair-1409935399',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-kk2xmpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=1f6a8436-ae6e-4edb-8046-baccf72c6560,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "0a750543-2d73-441e-82df-c608edcbea0a", "address": "fa:16:3e:b7:83:e9", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a750543-2d", "ovs_interfaceid": "0a750543-2d73-441e-82df-c608edcbea0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG os_vif [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a750543-2d, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3482decf-8115-446f-89df-2c14cbdc9896) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:43 user nova-compute[74820]: INFO os_vif [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:83:e9,bridge_name='br-int',has_traffic_filtering=True,id=0a750543-2d73-441e-82df-c608edcbea0a,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a750543-2d')
Nov 08 18:33:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Deleting instance files /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560_del
Nov 08 18:33:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Deletion of /opt/stack/data/nova/instances/1f6a8436-ae6e-4edb-8046-baccf72c6560_del complete
Nov 08 18:33:43 user nova-compute[74820]: INFO nova.compute.manager [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 18:33:43 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:33:43 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:33:44 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:33:44 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Took 0.78 seconds to deallocate network for instance.
Nov 08 18:33:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:45 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Deleted allocations for instance 1f6a8436-ae6e-4edb-8046-baccf72c6560
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-929b2305-84a9-415c-a6a5-bae700139c89 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] Acquiring lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] Lock "1f6a8436-ae6e-4edb-8046-baccf72c6560-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] No waiting events found dispatching network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:45 user nova-compute[74820]: WARNING nova.compute.manager [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received unexpected event network-vif-plugged-0a750543-2d73-441e-82df-c608edcbea0a for instance with vm_state deleted and task_state None.
Nov 08 18:33:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-44a78109-0e85-4bb1-a596-6e104fde5974 req-2ee3450b-c942-4bf2-9d58-54695384990a service nova] [instance: 1f6a8436-ae6e-4edb-8046-baccf72c6560] Received event network-vif-deleted-0a750543-2d73-441e-82df-c608edcbea0a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:45 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:33:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:33:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7838MB free_disk=25.35140609741211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 94bf2982-61c7-41a3-9aeb-3cc34cd3111b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:33:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:33:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:33:51 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Creating image(s)
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk 1073741824" returned: 0 in 0.060s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Cannot resize image /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Ensure instance console log exists: /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Start _get_guest_xml network_info=[{"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '7342ead2-59e6-4e02-ae1a-24a2ab1540fd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42d369f9-f38b-4ddf-acb7-72f3f54f7f8f', 'attached_at': '', 'detached_at': '', 'volume_id': '12e4ae67-651f-4d37-9772-31e29bf263c0', 'serial': '12e4ae67-651f-4d37-9772-31e29bf263c0'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:33:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 18:33:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:33:52 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:52 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:33:52 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0d0641-9848-4386-8c0d-245aa0df83b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:33:52 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33ce9a-837b-4ae5-bcaa-dc2ab5ab23a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0] added
Nov 08 18:33:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fa205d-f530-45c9-bd01-921c7f62fc40]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6a896-4a36-4661-87de-1c29f75ee66d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvlOPApb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvlOPApb" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e223850e-3e97-4a6f-8ea0-99edcf31bcec]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvlOPApb'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81d595-6fe3-40bc-9dd3-d272366659fa]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcd6594-22a1-456e-8e9a-09d751a6c191]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b358417-f4f6-473a-aec0-96eaf6e36d88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]
Nov 08 18:33:52 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.
Nov 08 18:33:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05a9467-b95f-4349-8e85-dba0febc5d27]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[426ff0da-a82e-4c4a-87fc-cce157631f7b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:33:52 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:33:52 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:33:52 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d19b12-59d1-4242-87ed-3d3ceb09bdf6]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:33:52 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26138386232376239', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138386232376239', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-674409609',display_name='tempest-ServerActionsTestOtherA-server-2011474520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-674409609',id=14,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOyJSZaNwBdRj1hWE7uv2aBJY3g3C1v/eMFBUqPoGZMPW+a7ET03xsrCvH7D3VLG92nqRTg+wE3xk+rVA03MMCw0PZt/WhLbrYFQrzWlgDZ9P1DrK6EcLhnLTDNNa1HQA==',key_name='tempest-keypair-1672348396',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:31:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-8rmn5v7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=42d369f9-f38b-4ddf-acb7-72f3f54f7f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:33:53 user nova-compute[74820]:   <uuid>42d369f9-f38b-4ddf-acb7-72f3f54f7f8f</uuid>
Nov 08 18:33:53 user nova-compute[74820]:   <name>instance-0000000e</name>
Nov 08 18:33:53 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:33:53 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:33:53 user nova-compute[74820]:   <metadata>
Nov 08 18:33:53 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:33:53 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:33:53 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherA-server-2011474520</nova:name>
Nov 08 18:33:53 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:33:52</nova:creationTime>
Nov 08 18:33:53 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:33:53 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:33:53 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:33:53 user nova-compute[74820]:       <nova:owner>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:user uuid="1a29988069fd43e0bfdb7b08a1fcc5d9">tempest-ServerActionsTestOtherA-600897548-project-member</nova:user>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:project uuid="4cdef93b9fc745768902ae1afe39ae4a">tempest-ServerActionsTestOtherA-600897548</nova:project>
Nov 08 18:33:53 user nova-compute[74820]:       </nova:owner>
Nov 08 18:33:53 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:33:53 user nova-compute[74820]:       <nova:ports>
Nov 08 18:33:53 user nova-compute[74820]:         <nova:port uuid="4564ddbd-d3fa-45cc-81a3-76e687daf8b6">
Nov 08 18:33:53 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 18:33:53 user nova-compute[74820]:         </nova:port>
Nov 08 18:33:53 user nova-compute[74820]:       </nova:ports>
Nov 08 18:33:53 user nova-compute[74820]:     </nova:instance>
Nov 08 18:33:53 user nova-compute[74820]:   </metadata>
Nov 08 18:33:53 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:33:53 user nova-compute[74820]:     <system>
Nov 08 18:33:53 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:33:53 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:33:53 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:33:53 user nova-compute[74820]:       <entry name="serial">42d369f9-f38b-4ddf-acb7-72f3f54f7f8f</entry>
Nov 08 18:33:53 user nova-compute[74820]:       <entry name="uuid">42d369f9-f38b-4ddf-acb7-72f3f54f7f8f</entry>
Nov 08 18:33:53 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:33:53 user nova-compute[74820]:     </system>
Nov 08 18:33:53 user nova-compute[74820]:   </sysinfo>
Nov 08 18:33:53 user nova-compute[74820]:   <os>
Nov 08 18:33:53 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:33:53 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:33:53 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:33:53 user nova-compute[74820]:   </os>
Nov 08 18:33:53 user nova-compute[74820]:   <features>
Nov 08 18:33:53 user nova-compute[74820]:     <acpi/>
Nov 08 18:33:53 user nova-compute[74820]:     <apic/>
Nov 08 18:33:53 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:33:53 user nova-compute[74820]:   </features>
Nov 08 18:33:53 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:33:53 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:33:53 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:33:53 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:33:53 user nova-compute[74820]:   </clock>
Nov 08 18:33:53 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:33:53 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:33:53 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:33:53 user nova-compute[74820]:   </cpu>
Nov 08 18:33:53 user nova-compute[74820]:   <devices>
Nov 08 18:33:53 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:33:53 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:33:53 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk"/>
Nov 08 18:33:53 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:33:53 user nova-compute[74820]:     </disk>
Nov 08 18:33:53 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:33:53 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:33:53 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 18:33:53 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:33:53 user nova-compute[74820]:       <serial>12e4ae67-651f-4d37-9772-31e29bf263c0</serial>
Nov 08 18:33:53 user nova-compute[74820]:     </disk>
Nov 08 18:33:53 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:33:53 user nova-compute[74820]:       <mac address="fa:16:3e:92:ce:7a"/>
Nov 08 18:33:53 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:33:53 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:33:53 user nova-compute[74820]:       <target dev="tap4564ddbd-d3"/>
Nov 08 18:33:53 user nova-compute[74820]:     </interface>
Nov 08 18:33:53 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:33:53 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/console.log" append="off"/>
Nov 08 18:33:53 user nova-compute[74820]:     </serial>
Nov 08 18:33:53 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:33:53 user nova-compute[74820]:     <video>
Nov 08 18:33:53 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:33:53 user nova-compute[74820]:     </video>
Nov 08 18:33:53 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:33:53 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:33:53 user nova-compute[74820]:     </rng>
Nov 08 18:33:53 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:33:53 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:33:53 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:33:53 user nova-compute[74820]:     </memballoon>
Nov 08 18:33:53 user nova-compute[74820]:   </devices>
Nov 08 18:33:53 user nova-compute[74820]: </domain>
Nov 08 18:33:53 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-674409609',display_name='tempest-ServerActionsTestOtherA-server-2011474520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-674409609',id=14,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOyJSZaNwBdRj1hWE7uv2aBJY3g3C1v/eMFBUqPoGZMPW+a7ET03xsrCvH7D3VLG92nqRTg+wE3xk+rVA03MMCw0PZt/WhLbrYFQrzWlgDZ9P1DrK6EcLhnLTDNNa1HQA==',key_name='tempest-keypair-1672348396',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:31:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-8rmn5v7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=42d369f9-f38b-4ddf-acb7-72f3f54f7f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG os_vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd4c6388-7965-560c-84e0-747d01c22a90', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4564ddbd-d3, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4564ddbd-d3, col_values=(('qos', UUID('9001adea-8dea-4e75-9fbe-4b28a2d54f1d')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4564ddbd-d3, col_values=(('external_ids', {'iface-id': '4564ddbd-d3fa-45cc-81a3-76e687daf8b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:ce:7a', 'vm-uuid': '42d369f9-f38b-4ddf-acb7-72f3f54f7f8f'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:33:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:53 user nova-compute[74820]: INFO os_vif [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3')
Nov 08 18:33:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:33:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:33:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No VIF found with MAC fa:16:3e:92:ce:7a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-8b3f13c3-ad50-4ffd-b9fe-a3f04b5759dc req-5cd99a69-0c10-4ad0-9feb-41c6b87e549a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8b3f13c3-ad50-4ffd-b9fe-a3f04b5759dc req-5cd99a69-0c10-4ad0-9feb-41c6b87e549a service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8b3f13c3-ad50-4ffd-b9fe-a3f04b5759dc req-5cd99a69-0c10-4ad0-9feb-41c6b87e549a service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8b3f13c3-ad50-4ffd-b9fe-a3f04b5759dc req-5cd99a69-0c10-4ad0-9feb-41c6b87e549a service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-8b3f13c3-ad50-4ffd-b9fe-a3f04b5759dc req-5cd99a69-0c10-4ad0-9feb-41c6b87e549a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:55 user nova-compute[74820]: WARNING nova.compute.manager [req-8b3f13c3-ad50-4ffd-b9fe-a3f04b5759dc req-5cd99a69-0c10-4ad0-9feb-41c6b87e549a service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:33:57 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance spawned successfully.
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-3f9eadae-54c1-4f2c-bce7-77d2c3065e38 req-4b757c87-b138-435c-8b27-cd708e6a48b3 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3f9eadae-54c1-4f2c-bce7-77d2c3065e38 req-4b757c87-b138-435c-8b27-cd708e6a48b3 service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3f9eadae-54c1-4f2c-bce7-77d2c3065e38 req-4b757c87-b138-435c-8b27-cd708e6a48b3 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3f9eadae-54c1-4f2c-bce7-77d2c3065e38 req-4b757c87-b138-435c-8b27-cd708e6a48b3 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-3f9eadae-54c1-4f2c-bce7-77d2c3065e38 req-4b757c87-b138-435c-8b27-cd708e6a48b3 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:33:57 user nova-compute[74820]: WARNING nova.compute.manager [req-3f9eadae-54c1-4f2c-bce7-77d2c3065e38 req-4b757c87-b138-435c-8b27-cd708e6a48b3 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 18:33:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74820) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 18:33:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e66bc23-1d4c-4a1a-8cad-28fa1c89d153 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:33:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-changed-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Refreshing instance network info cache due to event network-changed-08ae7236-8687-44f7-aa2f-769b535110cd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] Acquiring lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] Acquired lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Refreshing network info cache for port 08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:02 user nova-compute[74820]: DEBUG nova.objects.instance [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'flavor' on Instance uuid 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Ignoring supplied device name: /dev/vdb
Nov 08 18:34:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:03 user nova-compute[74820]: INFO nova.compute.manager [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Attaching volume 03083d2b-2659-45b7-b1fa-0568f7adb955 to /dev/vdb
Nov 08 18:34:03 user nova-compute[74820]: DEBUG os_brick.utils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c16cf-73a5-4ee9-ac7e-426120fffe18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d1e206-9ee7-466f-9527-e124c461f372]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af6731-c029-4f9b-bb7c-8500362b1290]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d1a112-7c32-456c-950a-b6cb6b247819]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:34:03 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0a660-9c38-41d5-a660-bb3b81fbd356]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG os_brick.utils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updating existing volume attachment record: ead806b4-f959-4750-9527-a37f5f30982e {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG nova.network.neutron [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updated VIF entry in instance network info cache for port 08ae7236-8687-44f7-aa2f-769b535110cd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG nova.network.neutron [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updating instance_info_cache with network_info: [{"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-78b77433-af44-405a-aa4b-e097d583a84d req-02cd06e2-f893-473c-9121-d08d8b061958 service nova] Releasing lock "refresh_cache-3193361a-b8aa-4d53-a7ef-7bb70af53303" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Starting finish_revert_migration {{(pid=74820) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start _get_guest_xml network_info=[{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '809dd17d-84e0-4350-8847-c7b49dee9c6e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a19102f1-af5a-4cb1-876f-8d053abed70b', 'attached_at': '2023-11-08T18:34:16.000000', 'detached_at': '', 'volume_id': 'b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'serial': 'b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:34:16 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:16 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'vcpu_model' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:34:16 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:34:16 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:34:16 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a0e1f-ba3e-4a60-ac46-ff7568a0939d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:34:16 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[96905610-9084-4325-bfaa-00116ecf51c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c] added
Nov 08 18:34:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f234810-11f2-475c-b577-76ace551a369]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2a91c3-396d-4d58-8264-fca30d70a393]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArcIaCeV {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ArcIaCeV" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad9291-5af0-4ab8-bb46-5ee225955f49]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ArcIaCeV'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0f76a0-efa5-4d19-a054-22903c4fb511]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870cec6-6cea-41e4-8815-59b58d1adb68]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:16 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:16 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b2621-f8ac-4c92-9e7e-d70c60877b0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]
Nov 08 18:34:16 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.
Nov 08 18:34:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc07fd50-e891-467a-9ae7-22e885e6cecb]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f84f50c-69eb-47c3-9fb3-60af66aa7ff5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:16 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:34:16 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:16 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:34:16 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21df5f-090a-4431-9c98-7507011c2126]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:34:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26366333637613330', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366333637613330', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:34:17 user nova-compute[74820]:   <uuid>a19102f1-af5a-4cb1-876f-8d053abed70b</uuid>
Nov 08 18:34:17 user nova-compute[74820]:   <name>instance-00000005</name>
Nov 08 18:34:17 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:34:17 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:34:17 user nova-compute[74820]:   <metadata>
Nov 08 18:34:17 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:34:17 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:34:17 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherB-server-276469762</nova:name>
Nov 08 18:34:17 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:34:16</nova:creationTime>
Nov 08 18:34:17 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:34:17 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:34:17 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:34:17 user nova-compute[74820]:       <nova:owner>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:user uuid="8d7a66f28dd1417980df3a2f3a64bc0e">tempest-ServerActionsTestOtherB-740424869-project-member</nova:user>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:project uuid="e230a1c67e924522b88cfc57decccb17">tempest-ServerActionsTestOtherB-740424869</nova:project>
Nov 08 18:34:17 user nova-compute[74820]:       </nova:owner>
Nov 08 18:34:17 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:34:17 user nova-compute[74820]:       <nova:ports>
Nov 08 18:34:17 user nova-compute[74820]:         <nova:port uuid="85125f2a-e0c8-4893-8e27-7036ee1bb847">
Nov 08 18:34:17 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:34:17 user nova-compute[74820]:         </nova:port>
Nov 08 18:34:17 user nova-compute[74820]:       </nova:ports>
Nov 08 18:34:17 user nova-compute[74820]:     </nova:instance>
Nov 08 18:34:17 user nova-compute[74820]:   </metadata>
Nov 08 18:34:17 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:34:17 user nova-compute[74820]:     <system>
Nov 08 18:34:17 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:34:17 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:34:17 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:34:17 user nova-compute[74820]:       <entry name="serial">a19102f1-af5a-4cb1-876f-8d053abed70b</entry>
Nov 08 18:34:17 user nova-compute[74820]:       <entry name="uuid">a19102f1-af5a-4cb1-876f-8d053abed70b</entry>
Nov 08 18:34:17 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:34:17 user nova-compute[74820]:     </system>
Nov 08 18:34:17 user nova-compute[74820]:   </sysinfo>
Nov 08 18:34:17 user nova-compute[74820]:   <os>
Nov 08 18:34:17 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:34:17 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:34:17 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:34:17 user nova-compute[74820]:   </os>
Nov 08 18:34:17 user nova-compute[74820]:   <features>
Nov 08 18:34:17 user nova-compute[74820]:     <acpi/>
Nov 08 18:34:17 user nova-compute[74820]:     <apic/>
Nov 08 18:34:17 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:34:17 user nova-compute[74820]:   </features>
Nov 08 18:34:17 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:34:17 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:34:17 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:34:17 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:34:17 user nova-compute[74820]:   </clock>
Nov 08 18:34:17 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:34:17 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:34:17 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:34:17 user nova-compute[74820]:   </cpu>
Nov 08 18:34:17 user nova-compute[74820]:   <devices>
Nov 08 18:34:17 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:34:17 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:34:17 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk"/>
Nov 08 18:34:17 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:34:17 user nova-compute[74820]:     </disk>
Nov 08 18:34:17 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:34:17 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:34:17 user nova-compute[74820]:       <source dev="/dev/sdc"/>
Nov 08 18:34:17 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:34:17 user nova-compute[74820]:       <serial>b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c</serial>
Nov 08 18:34:17 user nova-compute[74820]:     </disk>
Nov 08 18:34:17 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:34:17 user nova-compute[74820]:       <mac address="fa:16:3e:33:c7:d1"/>
Nov 08 18:34:17 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:34:17 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:34:17 user nova-compute[74820]:       <target dev="tap85125f2a-e0"/>
Nov 08 18:34:17 user nova-compute[74820]:     </interface>
Nov 08 18:34:17 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:34:17 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/console.log" append="off"/>
Nov 08 18:34:17 user nova-compute[74820]:     </serial>
Nov 08 18:34:17 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:34:17 user nova-compute[74820]:     <video>
Nov 08 18:34:17 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:34:17 user nova-compute[74820]:     </video>
Nov 08 18:34:17 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:34:17 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:34:17 user nova-compute[74820]:     </rng>
Nov 08 18:34:17 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:34:17 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:34:17 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:34:17 user nova-compute[74820]:     </memballoon>
Nov 08 18:34:17 user nova-compute[74820]:   </devices>
Nov 08 18:34:17 user nova-compute[74820]: </domain>
Nov 08 18:34:17 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG os_vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '532370fb-be92-5fb5-97c0-d2ab2c7d0977', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85125f2a-e0, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85125f2a-e0, col_values=(('qos', UUID('0600228a-7b28-4d2c-8c25-6f9892ee24ca')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85125f2a-e0, col_values=(('external_ids', {'iface-id': '85125f2a-e0c8-4893-8e27-7036ee1bb847', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c7:d1', 'vm-uuid': 'a19102f1-af5a-4cb1-876f-8d053abed70b'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:17 user nova-compute[74820]: INFO os_vif [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0')
Nov 08 18:34:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:18 user nova-compute[74820]: INFO nova.compute.manager [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Unrescuing
Nov 08 18:34:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG nova.objects.instance [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'flavor' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-0173cabb-add4-4c78-99ea-5bb62ee88931 req-d8f64623-9475-4972-9bbc-d998c7082e5c service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0173cabb-add4-4c78-99ea-5bb62ee88931 req-d8f64623-9475-4972-9bbc-d998c7082e5c service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0173cabb-add4-4c78-99ea-5bb62ee88931 req-d8f64623-9475-4972-9bbc-d998c7082e5c service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0173cabb-add4-4c78-99ea-5bb62ee88931 req-d8f64623-9475-4972-9bbc-d998c7082e5c service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-0173cabb-add4-4c78-99ea-5bb62ee88931 req-d8f64623-9475-4972-9bbc-d998c7082e5c service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:19 user nova-compute[74820]: WARNING nova.compute.manager [req-0173cabb-add4-4c78-99ea-5bb62ee88931 req-d8f64623-9475-4972-9bbc-d998c7082e5c service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:34:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance destroyed successfully.
Nov 08 18:34:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:21 user nova-compute[74820]: WARNING nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:34:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:21 user nova-compute[74820]: WARNING nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state resized and task_state resize_reverting.
Nov 08 18:34:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:21 user nova-compute[74820]: WARNING nova.compute.manager [req-ca4674ac-1240-4f35-8828-c17e9a2f8f93 req-1c992b1c-db34-4b6c-b2db-80b0212c45b1 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state resized and task_state resize_reverting.
Nov 08 18:34:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:34:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance running successfully.
Nov 08 18:34:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] finish_revert_migration finished successfully. {{(pid=74820) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 18:34:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:22 user nova-compute[74820]: INFO nova.compute.manager [None req-e98b09ba-dc6d-4503-9607-2392601f426f tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance to original state: 'active'
Nov 08 18:34:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:23 user nova-compute[74820]: WARNING nova.compute.manager [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:34:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:23 user nova-compute[74820]: WARNING nova.compute.manager [req-ca52ddae-a573-4dea-8132-c3a62bcda1c6 req-9a9f9b75-559c-45ca-b1eb-e2b3c34a5e0f service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:34:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d22db8ce-4677-42af-bd5e-f525ef91d4c6 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:34:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOuzAypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:34:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:34:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:34:30 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ea9da-0c7b-46a4-ae16-bad238401ff3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:34:30 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[897676a5-d658-44df-b9e8-a79036023263]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955] added
Nov 08 18:34:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dbd189-a58b-4cfd-8455-92d7a1c42cc2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9479a8-5734-4a92-8ed0-a79a7e69973c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rOuzAypJ {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rOuzAypJ" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c23e60-a6da-4dd8-97df-69ea2e1d1150]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rOuzAypJ'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d444f-0dcd-40c5-b886-defcd83dbcd9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa05d7d-7bad-42ad-b87f-81d255427bd9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b98f23-e6f4-488f-a628-d96bd63c0a66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260]
Nov 08 18:34:30 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260] successful.
Nov 08 18:34:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9688197d-c88b-4168-af45-3b7628c751fa]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fe9627-c1b2-4727-9dd6-95651e4cd2fb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:34:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:34:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440216e-e2c5-4766-b8f0-a70688ff46fd]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:34:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOuzAypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23465613031346630', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465613031346630', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'flavor' on Instance uuid 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:34:31 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:34:31 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:34:31 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:34:31 user nova-compute[74820]:   <serial>03083d2b-2659-45b7-b1fa-0568f7adb955</serial>
Nov 08 18:34:31 user nova-compute[74820]: </disk>
Nov 08 18:34:31 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:34:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:34:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:34:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No VIF found with MAC fa:16:3e:fb:68:7a, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:34:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fc483385-26b6-4303-b603-7cc67bf4db1b tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.245s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:34:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:34 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:34:34 user nova-compute[74820]: INFO nova.compute.claims [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Claim successful on node user
Nov 08 18:34:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:34:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.policy [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecfee2b968614f47aa97aafd07b66548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f45aa33327417986332546abed6d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:34:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Creating image(s)
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "/opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.046s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.375s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk 1073741824" returned: 0 in 0.059s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Successfully created port: df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Cannot resize image /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Ensure instance console log exists: /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Successfully updated port: df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquired lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-changed-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Refreshing instance network info cache due to event network-changed-df8c6068-1bc4-4305-8774-c7f031143636. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] Acquiring lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:34:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updating instance_info_cache with network_info: [{"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Releasing lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Instance network_info: |[{"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] Acquired lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Refreshing network info cache for port df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Start _get_guest_xml network_info=[{"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:34:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914672766',display_name='tempest-AttachVolumeNegativeTest-server-1914672766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914672766',id=18,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqJRrMbTBhjYY5p23jr+qHP+TupoWKuJjf3TqixCjJjRRbAAZlAwPu0NODdSpBDTmiqRuo50SbNCG22aA4aeX2SgmKGKLJQ4tNLI5qkcPfyE89hINyGIQx9diaDGDbVw==',key_name='tempest-keypair-205483661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-xq73rmpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=490de0ea-289a-45aa-bb05-14fb138fb833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'pci_devices' on Instance uuid 490de0ea-289a-45aa-bb05-14fb138fb833 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:34:38 user nova-compute[74820]:   <uuid>490de0ea-289a-45aa-bb05-14fb138fb833</uuid>
Nov 08 18:34:38 user nova-compute[74820]:   <name>instance-00000012</name>
Nov 08 18:34:38 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:34:38 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:34:38 user nova-compute[74820]:   <metadata>
Nov 08 18:34:38 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:34:38 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:34:38 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1914672766</nova:name>
Nov 08 18:34:38 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:34:38</nova:creationTime>
Nov 08 18:34:38 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:34:38 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:34:38 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:34:38 user nova-compute[74820]:       <nova:owner>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:user uuid="ecfee2b968614f47aa97aafd07b66548">tempest-AttachVolumeNegativeTest-657533753-project-member</nova:user>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:project uuid="d4f45aa33327417986332546abed6d92">tempest-AttachVolumeNegativeTest-657533753</nova:project>
Nov 08 18:34:38 user nova-compute[74820]:       </nova:owner>
Nov 08 18:34:38 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:34:38 user nova-compute[74820]:       <nova:ports>
Nov 08 18:34:38 user nova-compute[74820]:         <nova:port uuid="df8c6068-1bc4-4305-8774-c7f031143636">
Nov 08 18:34:38 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:34:38 user nova-compute[74820]:         </nova:port>
Nov 08 18:34:38 user nova-compute[74820]:       </nova:ports>
Nov 08 18:34:38 user nova-compute[74820]:     </nova:instance>
Nov 08 18:34:38 user nova-compute[74820]:   </metadata>
Nov 08 18:34:38 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:34:38 user nova-compute[74820]:     <system>
Nov 08 18:34:38 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:34:38 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:34:38 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:34:38 user nova-compute[74820]:       <entry name="serial">490de0ea-289a-45aa-bb05-14fb138fb833</entry>
Nov 08 18:34:38 user nova-compute[74820]:       <entry name="uuid">490de0ea-289a-45aa-bb05-14fb138fb833</entry>
Nov 08 18:34:38 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:34:38 user nova-compute[74820]:     </system>
Nov 08 18:34:38 user nova-compute[74820]:   </sysinfo>
Nov 08 18:34:38 user nova-compute[74820]:   <os>
Nov 08 18:34:38 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:34:38 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:34:38 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:34:38 user nova-compute[74820]:   </os>
Nov 08 18:34:38 user nova-compute[74820]:   <features>
Nov 08 18:34:38 user nova-compute[74820]:     <acpi/>
Nov 08 18:34:38 user nova-compute[74820]:     <apic/>
Nov 08 18:34:38 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:34:38 user nova-compute[74820]:   </features>
Nov 08 18:34:38 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:34:38 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:34:38 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:34:38 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:34:38 user nova-compute[74820]:   </clock>
Nov 08 18:34:38 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:34:38 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:34:38 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:34:38 user nova-compute[74820]:   </cpu>
Nov 08 18:34:38 user nova-compute[74820]:   <devices>
Nov 08 18:34:38 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:34:38 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:34:38 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk"/>
Nov 08 18:34:38 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:34:38 user nova-compute[74820]:     </disk>
Nov 08 18:34:38 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:34:38 user nova-compute[74820]:       <mac address="fa:16:3e:91:a7:04"/>
Nov 08 18:34:38 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:34:38 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:34:38 user nova-compute[74820]:       <target dev="tapdf8c6068-1b"/>
Nov 08 18:34:38 user nova-compute[74820]:     </interface>
Nov 08 18:34:38 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:34:38 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/console.log" append="off"/>
Nov 08 18:34:38 user nova-compute[74820]:     </serial>
Nov 08 18:34:38 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:34:38 user nova-compute[74820]:     <video>
Nov 08 18:34:38 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:34:38 user nova-compute[74820]:     </video>
Nov 08 18:34:38 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:34:38 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:34:38 user nova-compute[74820]:     </rng>
Nov 08 18:34:38 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:34:38 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:34:38 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:34:38 user nova-compute[74820]:     </memballoon>
Nov 08 18:34:38 user nova-compute[74820]:   </devices>
Nov 08 18:34:38 user nova-compute[74820]: </domain>
Nov 08 18:34:38 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914672766',display_name='tempest-AttachVolumeNegativeTest-server-1914672766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914672766',id=18,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqJRrMbTBhjYY5p23jr+qHP+TupoWKuJjf3TqixCjJjRRbAAZlAwPu0NODdSpBDTmiqRuo50SbNCG22aA4aeX2SgmKGKLJQ4tNLI5qkcPfyE89hINyGIQx9diaDGDbVw==',key_name='tempest-keypair-205483661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-xq73rmpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=490de0ea-289a-45aa-bb05-14fb138fb833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG os_vif [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6afc5afe-06d9-5a21-91c4-77fe6ba48364', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf8c6068-1b, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf8c6068-1b, col_values=(('qos', UUID('8f9ed569-25f6-4a00-a58b-9e257a916f61')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf8c6068-1b, col_values=(('external_ids', {'iface-id': 'df8c6068-1bc4-4305-8774-c7f031143636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:a7:04', 'vm-uuid': '490de0ea-289a-45aa-bb05-14fb138fb833'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:38 user nova-compute[74820]: INFO os_vif [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b')
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No VIF found with MAC fa:16:3e:91:a7:04, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updated VIF entry in instance network info cache for port df8c6068-1bc4-4305-8774-c7f031143636. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updating instance_info_cache with network_info: [{"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17f343f9-16e2-475d-8ad0-32685ac28ef7 req-43fd0e4e-1ac2-4b45-912b-260545c0e407 service nova] Releasing lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:34:38 user nova-compute[74820]: INFO nova.compute.claims [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Claim successful on node user
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:34:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.policy [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6adeab5384fc4d8fad36575d715cf133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c3b99ebc044d32a5647dc7963f11ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:34:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Creating image(s)
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.288s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.326s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk 1073741824" returned: 0 in 0.099s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.442s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.260s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Cannot resize image /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Ensure instance console log exists: /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-d09d0798-c36a-440f-8208-bc151124cb6d req-0f308119-4914-47fd-8049-645e1a9b2fa0 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d09d0798-c36a-440f-8208-bc151124cb6d req-0f308119-4914-47fd-8049-645e1a9b2fa0 service nova] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d09d0798-c36a-440f-8208-bc151124cb6d req-0f308119-4914-47fd-8049-645e1a9b2fa0 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d09d0798-c36a-440f-8208-bc151124cb6d req-0f308119-4914-47fd-8049-645e1a9b2fa0 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-d09d0798-c36a-440f-8208-bc151124cb6d req-0f308119-4914-47fd-8049-645e1a9b2fa0 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] No waiting events found dispatching network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:40 user nova-compute[74820]: WARNING nova.compute.manager [req-d09d0798-c36a-440f-8208-bc151124cb6d req-0f308119-4914-47fd-8049-645e1a9b2fa0 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received unexpected event network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 for instance with vm_state building and task_state spawning.
Nov 08 18:34:40 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Successfully created port: 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:34:41 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Successfully updated port: 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:34:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:41 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:34:41 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance network_info: |[{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Start _get_guest_xml network_info=[{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:34:42 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:42 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-672706708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-672706708',id=19,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeLu4U4L/nu4w3Uc7Um1BOuM1F3kA/OXwZyWRqqh9o3mYLxOrgGDWs85OnJTRDpbbjY/NhHJY6FDRaCDLZDsO/TmP3WWpBN6cTir9wTkID2/xs8OZJgEvde2BURzWe0UA==',key_name='tempest-keypair-1190867603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-mkchcuj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=2c0484b3-8be4-430f-9436-1f2f095414f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.objects.instance [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:34:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Instance spawned successfully.
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:34:42 user nova-compute[74820]:   <uuid>2c0484b3-8be4-430f-9436-1f2f095414f7</uuid>
Nov 08 18:34:42 user nova-compute[74820]:   <name>instance-00000013</name>
Nov 08 18:34:42 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:34:42 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:34:42 user nova-compute[74820]:   <metadata>
Nov 08 18:34:42 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:34:42 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:34:42 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-672706708</nova:name>
Nov 08 18:34:42 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:34:42</nova:creationTime>
Nov 08 18:34:42 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:34:42 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:34:42 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:34:42 user nova-compute[74820]:       <nova:owner>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:user uuid="6adeab5384fc4d8fad36575d715cf133">tempest-AttachVolumeShelveTestJSON-1684933452-project-member</nova:user>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:project uuid="80c3b99ebc044d32a5647dc7963f11ae">tempest-AttachVolumeShelveTestJSON-1684933452</nova:project>
Nov 08 18:34:42 user nova-compute[74820]:       </nova:owner>
Nov 08 18:34:42 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:34:42 user nova-compute[74820]:       <nova:ports>
Nov 08 18:34:42 user nova-compute[74820]:         <nova:port uuid="784a7f5c-9e81-4ae6-a2ff-d687f6cab22d">
Nov 08 18:34:42 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 18:34:42 user nova-compute[74820]:         </nova:port>
Nov 08 18:34:42 user nova-compute[74820]:       </nova:ports>
Nov 08 18:34:42 user nova-compute[74820]:     </nova:instance>
Nov 08 18:34:42 user nova-compute[74820]:   </metadata>
Nov 08 18:34:42 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:34:42 user nova-compute[74820]:     <system>
Nov 08 18:34:42 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:34:42 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:34:42 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:34:42 user nova-compute[74820]:       <entry name="serial">2c0484b3-8be4-430f-9436-1f2f095414f7</entry>
Nov 08 18:34:42 user nova-compute[74820]:       <entry name="uuid">2c0484b3-8be4-430f-9436-1f2f095414f7</entry>
Nov 08 18:34:42 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:34:42 user nova-compute[74820]:     </system>
Nov 08 18:34:42 user nova-compute[74820]:   </sysinfo>
Nov 08 18:34:42 user nova-compute[74820]:   <os>
Nov 08 18:34:42 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:34:42 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:34:42 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:34:42 user nova-compute[74820]:   </os>
Nov 08 18:34:42 user nova-compute[74820]:   <features>
Nov 08 18:34:42 user nova-compute[74820]:     <acpi/>
Nov 08 18:34:42 user nova-compute[74820]:     <apic/>
Nov 08 18:34:42 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:34:42 user nova-compute[74820]:   </features>
Nov 08 18:34:42 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:34:42 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:34:42 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:34:42 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:34:42 user nova-compute[74820]:   </clock>
Nov 08 18:34:42 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:34:42 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:34:42 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:34:42 user nova-compute[74820]:   </cpu>
Nov 08 18:34:42 user nova-compute[74820]:   <devices>
Nov 08 18:34:42 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:34:42 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:34:42 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk"/>
Nov 08 18:34:42 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:34:42 user nova-compute[74820]:     </disk>
Nov 08 18:34:42 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:34:42 user nova-compute[74820]:       <mac address="fa:16:3e:87:bc:ee"/>
Nov 08 18:34:42 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:34:42 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:34:42 user nova-compute[74820]:       <target dev="tap784a7f5c-9e"/>
Nov 08 18:34:42 user nova-compute[74820]:     </interface>
Nov 08 18:34:42 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:34:42 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/console.log" append="off"/>
Nov 08 18:34:42 user nova-compute[74820]:     </serial>
Nov 08 18:34:42 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:34:42 user nova-compute[74820]:     <video>
Nov 08 18:34:42 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:34:42 user nova-compute[74820]:     </video>
Nov 08 18:34:42 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:34:42 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:34:42 user nova-compute[74820]:     </rng>
Nov 08 18:34:42 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:34:42 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:34:42 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:34:42 user nova-compute[74820]:     </memballoon>
Nov 08 18:34:42 user nova-compute[74820]:   </devices>
Nov 08 18:34:42 user nova-compute[74820]: </domain>
Nov 08 18:34:42 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-672706708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-672706708',id=19,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeLu4U4L/nu4w3Uc7Um1BOuM1F3kA/OXwZyWRqqh9o3mYLxOrgGDWs85OnJTRDpbbjY/NhHJY6FDRaCDLZDsO/TmP3WWpBN6cTir9wTkID2/xs8OZJgEvde2BURzWe0UA==',key_name='tempest-keypair-1190867603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-mkchcuj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=2c0484b3-8be4-430f-9436-1f2f095414f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG os_vif [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f57d10c1-1882-548f-aeb8-dc35b6832fec', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap784a7f5c-9e, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap784a7f5c-9e, col_values=(('qos', UUID('d9cde53e-6c32-45aa-b0bf-e964b4563260')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap784a7f5c-9e, col_values=(('external_ids', {'iface-id': '784a7f5c-9e81-4ae6-a2ff-d687f6cab22d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:bc:ee', 'vm-uuid': '2c0484b3-8be4-430f-9436-1f2f095414f7'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:42 user nova-compute[74820]: INFO os_vif [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e')
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No VIF found with MAC fa:16:3e:87:bc:ee, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:34:42 user nova-compute[74820]: INFO nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:34:42 user nova-compute[74820]: INFO nova.compute.manager [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Took 8.14 seconds to build instance.
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f96158d5-07bd-4beb-983b-c36e7c440afa tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.278s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] No waiting events found dispatching network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:42 user nova-compute[74820]: WARNING nova.compute.manager [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received unexpected event network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 for instance with vm_state active and task_state None.
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing instance network info cache due to event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG nova.network.neutron [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:34:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:43 user nova-compute[74820]: DEBUG nova.network.neutron [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updated VIF entry in instance network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:34:43 user nova-compute[74820]: DEBUG nova.network.neutron [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0f68c409-0c07-40d7-b706-9bc33f9cebef req-376fd5aa-b1c6-480a-8a7f-1c796b90ced1 service nova] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:44 user nova-compute[74820]: WARNING nova.compute.manager [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state building and task_state spawning.
Nov 08 18:34:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:34:44 user nova-compute[74820]: WARNING nova.compute.manager [req-9150419c-d982-444d-b0d9-b5d95fa9806e req-1a5fec95-a20a-4241-9503-6dd93cc71a6e service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state building and task_state spawning.
Nov 08 18:34:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:34:46 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance spawned successfully.
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:46 user nova-compute[74820]: INFO nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Took 7.47 seconds to spawn the instance on the hypervisor.
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:34:47 user nova-compute[74820]: INFO nova.compute.manager [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Took 8.44 seconds to build instance.
Nov 08 18:34:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5e84052a-23da-48c5-9b17-adb2eccafd51 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.567s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:34:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:34:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=25.34137725830078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 94bf2982-61c7-41a3-9aeb-3cc34cd3111b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 490de0ea-289a-45aa-bb05-14fb138fb833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2c0484b3-8be4-430f-9436-1f2f095414f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:34:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:34:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:34:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:34:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:34:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:34:54 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:34:54 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:34:55 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:34:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:34:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:34:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:34:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:34:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:34:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:35:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:35:06 user nova-compute[74820]: INFO nova.compute.claims [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Claim successful on node user
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:35:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:35:06 user nova-compute[74820]: DEBUG nova.policy [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c84ad1439444413bc8a2acfffff1f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008fbbc99e0b4aca939d6338fdd7fa82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:35:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Creating image(s)
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "/opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "/opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.246s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk 1073741824" returned: 0 in 0.070s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Successfully created port: 8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.229s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Cannot resize image /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Ensure instance console log exists: /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Successfully updated port: 8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquired lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-changed-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Refreshing instance network info cache due to event network-changed-8f2a7475-5e7a-4084-9686-9e7ba1e43262. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] Acquiring lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updating instance_info_cache with network_info: [{"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Releasing lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Instance network_info: |[{"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] Acquired lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Refreshing network info cache for port 8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Start _get_guest_xml network_info=[{"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:35:08 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:35:08 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:35:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1864489219',display_name='tempest-VolumesAdminNegativeTest-server-1864489219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1864489219',id=20,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZnhH6xsQD3s/fvfhC17F1k/hR/x8kA6jWi0+cr6plGcwoMbTwaOQ2QYA//pUxBOuQF5mIkvwoCNQsP0Nc5uTDKXcU6sy/6avpdTMzeVy4gIoHq4CqAoO30WcckHubRqw==',key_name='tempest-keypair-1327839767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='008fbbc99e0b4aca939d6338fdd7fa82',ramdisk_id='',reservation_id='r-sb2to0my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571307425',owner_user_name='tempest-VolumesAdminNegativeTest-571307425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c84ad1439444413bc8a2acfffff1f2b',uuid=d4bbc087-e9df-431d-9c42-9e10718e7e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converting VIF {"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.objects.instance [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'pci_devices' on Instance uuid d4bbc087-e9df-431d-9c42-9e10718e7e6d {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:35:09 user nova-compute[74820]:   <uuid>d4bbc087-e9df-431d-9c42-9e10718e7e6d</uuid>
Nov 08 18:35:09 user nova-compute[74820]:   <name>instance-00000014</name>
Nov 08 18:35:09 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:35:09 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:35:09 user nova-compute[74820]:   <metadata>
Nov 08 18:35:09 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:35:09 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:35:09 user nova-compute[74820]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1864489219</nova:name>
Nov 08 18:35:09 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:35:08</nova:creationTime>
Nov 08 18:35:09 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:35:09 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:35:09 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:35:09 user nova-compute[74820]:       <nova:owner>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:user uuid="3c84ad1439444413bc8a2acfffff1f2b">tempest-VolumesAdminNegativeTest-571307425-project-member</nova:user>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:project uuid="008fbbc99e0b4aca939d6338fdd7fa82">tempest-VolumesAdminNegativeTest-571307425</nova:project>
Nov 08 18:35:09 user nova-compute[74820]:       </nova:owner>
Nov 08 18:35:09 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:35:09 user nova-compute[74820]:       <nova:ports>
Nov 08 18:35:09 user nova-compute[74820]:         <nova:port uuid="8f2a7475-5e7a-4084-9686-9e7ba1e43262">
Nov 08 18:35:09 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 18:35:09 user nova-compute[74820]:         </nova:port>
Nov 08 18:35:09 user nova-compute[74820]:       </nova:ports>
Nov 08 18:35:09 user nova-compute[74820]:     </nova:instance>
Nov 08 18:35:09 user nova-compute[74820]:   </metadata>
Nov 08 18:35:09 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:35:09 user nova-compute[74820]:     <system>
Nov 08 18:35:09 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:35:09 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:35:09 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:35:09 user nova-compute[74820]:       <entry name="serial">d4bbc087-e9df-431d-9c42-9e10718e7e6d</entry>
Nov 08 18:35:09 user nova-compute[74820]:       <entry name="uuid">d4bbc087-e9df-431d-9c42-9e10718e7e6d</entry>
Nov 08 18:35:09 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:35:09 user nova-compute[74820]:     </system>
Nov 08 18:35:09 user nova-compute[74820]:   </sysinfo>
Nov 08 18:35:09 user nova-compute[74820]:   <os>
Nov 08 18:35:09 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:35:09 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:35:09 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:35:09 user nova-compute[74820]:   </os>
Nov 08 18:35:09 user nova-compute[74820]:   <features>
Nov 08 18:35:09 user nova-compute[74820]:     <acpi/>
Nov 08 18:35:09 user nova-compute[74820]:     <apic/>
Nov 08 18:35:09 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:35:09 user nova-compute[74820]:   </features>
Nov 08 18:35:09 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:35:09 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:35:09 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:35:09 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:35:09 user nova-compute[74820]:   </clock>
Nov 08 18:35:09 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:35:09 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:35:09 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:35:09 user nova-compute[74820]:   </cpu>
Nov 08 18:35:09 user nova-compute[74820]:   <devices>
Nov 08 18:35:09 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:35:09 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:35:09 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk"/>
Nov 08 18:35:09 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:35:09 user nova-compute[74820]:     </disk>
Nov 08 18:35:09 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:35:09 user nova-compute[74820]:       <mac address="fa:16:3e:bc:22:aa"/>
Nov 08 18:35:09 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:35:09 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:35:09 user nova-compute[74820]:       <target dev="tap8f2a7475-5e"/>
Nov 08 18:35:09 user nova-compute[74820]:     </interface>
Nov 08 18:35:09 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:35:09 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/console.log" append="off"/>
Nov 08 18:35:09 user nova-compute[74820]:     </serial>
Nov 08 18:35:09 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:35:09 user nova-compute[74820]:     <video>
Nov 08 18:35:09 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:35:09 user nova-compute[74820]:     </video>
Nov 08 18:35:09 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:35:09 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:35:09 user nova-compute[74820]:     </rng>
Nov 08 18:35:09 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:35:09 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:35:09 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:35:09 user nova-compute[74820]:     </memballoon>
Nov 08 18:35:09 user nova-compute[74820]:   </devices>
Nov 08 18:35:09 user nova-compute[74820]: </domain>
Nov 08 18:35:09 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1864489219',display_name='tempest-VolumesAdminNegativeTest-server-1864489219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1864489219',id=20,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZnhH6xsQD3s/fvfhC17F1k/hR/x8kA6jWi0+cr6plGcwoMbTwaOQ2QYA//pUxBOuQF5mIkvwoCNQsP0Nc5uTDKXcU6sy/6avpdTMzeVy4gIoHq4CqAoO30WcckHubRqw==',key_name='tempest-keypair-1327839767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='008fbbc99e0b4aca939d6338fdd7fa82',ramdisk_id='',reservation_id='r-sb2to0my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571307425',owner_user_name='tempest-VolumesAdminNegativeTest-571307425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c84ad1439444413bc8a2acfffff1f2b',uuid=d4bbc087-e9df-431d-9c42-9e10718e7e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converting VIF {"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG os_vif [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02f1ad3d-a871-59de-8dac-be1c09602339', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f2a7475-5e, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f2a7475-5e, col_values=(('qos', UUID('c6a930dc-3cf3-45d7-aa49-143de4a1507b')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f2a7475-5e, col_values=(('external_ids', {'iface-id': '8f2a7475-5e7a-4084-9686-9e7ba1e43262', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:22:aa', 'vm-uuid': 'd4bbc087-e9df-431d-9c42-9e10718e7e6d'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:09 user nova-compute[74820]: INFO os_vif [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e')
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No VIF found with MAC fa:16:3e:bc:22:aa, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updated VIF entry in instance network info cache for port 8f2a7475-5e7a-4084-9686-9e7ba1e43262. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updating instance_info_cache with network_info: [{"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d2d5af26-aa19-49cb-aea0-aca370ae4a56 req-f4987218-f9e3-4f8f-b806-fbb692466406 service nova] Releasing lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG nova.objects.instance [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lazy-loading 'flavor' on Instance uuid 94bf2982-61c7-41a3-9aeb-3cc34cd3111b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:11 user nova-compute[74820]: INFO nova.compute.manager [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Attaching volume af45eb38-46f9-470e-ab55-5caaad980500 to /dev/vdb
Nov 08 18:35:11 user nova-compute[74820]: DEBUG os_brick.utils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef586a5-6d47-4f62-9698-edb5ce562f9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b54c25-b72f-4930-98dd-89e6ee883038]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be88684d-8dbf-4140-9bcd-c30a09acd573]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[676e3adb-9fe0-41c2-8388-409c7b0409ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:35:11 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:35:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23252aab-ba62-4dde-a3c9-f1afcc25dcb2]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG os_brick.utils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Updating existing volume attachment record: 8ceffcf8-eec3-4057-a351-821571110d29 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-78abde57-2d47-4153-9f73-589fa70b9d5f req-7017defa-00e6-4936-aa7a-9dafccdd68ec service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-78abde57-2d47-4153-9f73-589fa70b9d5f req-7017defa-00e6-4936-aa7a-9dafccdd68ec service nova] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-78abde57-2d47-4153-9f73-589fa70b9d5f req-7017defa-00e6-4936-aa7a-9dafccdd68ec service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-78abde57-2d47-4153-9f73-589fa70b9d5f req-7017defa-00e6-4936-aa7a-9dafccdd68ec service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-78abde57-2d47-4153-9f73-589fa70b9d5f req-7017defa-00e6-4936-aa7a-9dafccdd68ec service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] No waiting events found dispatching network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:35:12 user nova-compute[74820]: WARNING nova.compute.manager [req-78abde57-2d47-4153-9f73-589fa70b9d5f req-7017defa-00e6-4936-aa7a-9dafccdd68ec service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received unexpected event network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 for instance with vm_state building and task_state spawning.
Nov 08 18:35:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:35:13 user nova-compute[74820]: INFO nova.compute.claims [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Claim successful on node user
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:35:13 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Instance spawned successfully.
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:13 user nova-compute[74820]: INFO nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:35:13 user nova-compute[74820]: INFO nova.compute.manager [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Took 7.82 seconds to build instance.
Nov 08 18:35:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-060596e6-3bc5-4930-af6c-934e926f098c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.962s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:35:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:35:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.policy [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da2d9ad108da46cca9b8c5d870e8076d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d2eda9ff724b288680a1ac55e667ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:35:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Creating image(s)
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "/opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "/opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-56ae2032-6c19-470e-86bf-b7bff72f8f8a req-65737a4f-4f75-474b-bff4-6b33a34e9862 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-56ae2032-6c19-470e-86bf-b7bff72f8f8a req-65737a4f-4f75-474b-bff4-6b33a34e9862 service nova] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-56ae2032-6c19-470e-86bf-b7bff72f8f8a req-65737a4f-4f75-474b-bff4-6b33a34e9862 service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-56ae2032-6c19-470e-86bf-b7bff72f8f8a req-65737a4f-4f75-474b-bff4-6b33a34e9862 service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-56ae2032-6c19-470e-86bf-b7bff72f8f8a req-65737a4f-4f75-474b-bff4-6b33a34e9862 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] No waiting events found dispatching network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:35:14 user nova-compute[74820]: WARNING nova.compute.manager [req-56ae2032-6c19-470e-86bf-b7bff72f8f8a req-65737a4f-4f75-474b-bff4-6b33a34e9862 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received unexpected event network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 for instance with vm_state active and task_state None.
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk 1073741824" returned: 0 in 0.072s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Successfully created port: d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:35:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.256s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Cannot resize image /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Ensure instance console log exists: /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Successfully updated port: d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "refresh_cache-fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquired lock "refresh_cache-fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Received event network-changed-d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Refreshing instance network info cache due to event network-changed-d1bd3dc6-765e-404a-bbbc-41b704a03e77. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] Acquiring lock "refresh_cache-fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Updating instance_info_cache with network_info: [{"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Releasing lock "refresh_cache-fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Instance network_info: |[{"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] Acquired lock "refresh_cache-fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:15 user nova-compute[74820]: DEBUG nova.network.neutron [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Refreshing network info cache for port d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Start _get_guest_xml network_info=[{"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:35:16 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:35:16 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-683820164',display_name='tempest-ServersNegativeTestJSON-server-683820164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-683820164',id=21,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16d2eda9ff724b288680a1ac55e667ce',ramdisk_id='',reservation_id='r-yrc21b2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-816870962',owner_user_name='tempest-ServersNegativeTestJSON-816870962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:35:14Z,user_data=None,user_id='da2d9ad108da46cca9b8c5d870e8076d',uuid=fb521d9b-a6c2-4673-9a3f-33dde9b5b79e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converting VIF {"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lazy-loading 'pci_devices' on Instance uuid fb521d9b-a6c2-4673-9a3f-33dde9b5b79e {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:35:16 user nova-compute[74820]:   <uuid>fb521d9b-a6c2-4673-9a3f-33dde9b5b79e</uuid>
Nov 08 18:35:16 user nova-compute[74820]:   <name>instance-00000015</name>
Nov 08 18:35:16 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:35:16 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:35:16 user nova-compute[74820]:   <metadata>
Nov 08 18:35:16 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:35:16 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:35:16 user nova-compute[74820]:       <nova:name>tempest-ServersNegativeTestJSON-server-683820164</nova:name>
Nov 08 18:35:16 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:35:16</nova:creationTime>
Nov 08 18:35:16 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:35:16 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:35:16 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:35:16 user nova-compute[74820]:       <nova:owner>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:user uuid="da2d9ad108da46cca9b8c5d870e8076d">tempest-ServersNegativeTestJSON-816870962-project-member</nova:user>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:project uuid="16d2eda9ff724b288680a1ac55e667ce">tempest-ServersNegativeTestJSON-816870962</nova:project>
Nov 08 18:35:16 user nova-compute[74820]:       </nova:owner>
Nov 08 18:35:16 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:35:16 user nova-compute[74820]:       <nova:ports>
Nov 08 18:35:16 user nova-compute[74820]:         <nova:port uuid="d1bd3dc6-765e-404a-bbbc-41b704a03e77">
Nov 08 18:35:16 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:35:16 user nova-compute[74820]:         </nova:port>
Nov 08 18:35:16 user nova-compute[74820]:       </nova:ports>
Nov 08 18:35:16 user nova-compute[74820]:     </nova:instance>
Nov 08 18:35:16 user nova-compute[74820]:   </metadata>
Nov 08 18:35:16 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:35:16 user nova-compute[74820]:     <system>
Nov 08 18:35:16 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:35:16 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:35:16 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:35:16 user nova-compute[74820]:       <entry name="serial">fb521d9b-a6c2-4673-9a3f-33dde9b5b79e</entry>
Nov 08 18:35:16 user nova-compute[74820]:       <entry name="uuid">fb521d9b-a6c2-4673-9a3f-33dde9b5b79e</entry>
Nov 08 18:35:16 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:35:16 user nova-compute[74820]:     </system>
Nov 08 18:35:16 user nova-compute[74820]:   </sysinfo>
Nov 08 18:35:16 user nova-compute[74820]:   <os>
Nov 08 18:35:16 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:35:16 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:35:16 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:35:16 user nova-compute[74820]:   </os>
Nov 08 18:35:16 user nova-compute[74820]:   <features>
Nov 08 18:35:16 user nova-compute[74820]:     <acpi/>
Nov 08 18:35:16 user nova-compute[74820]:     <apic/>
Nov 08 18:35:16 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:35:16 user nova-compute[74820]:   </features>
Nov 08 18:35:16 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:35:16 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:35:16 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:35:16 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:35:16 user nova-compute[74820]:   </clock>
Nov 08 18:35:16 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:35:16 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:35:16 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:35:16 user nova-compute[74820]:   </cpu>
Nov 08 18:35:16 user nova-compute[74820]:   <devices>
Nov 08 18:35:16 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:35:16 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:35:16 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk"/>
Nov 08 18:35:16 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:35:16 user nova-compute[74820]:     </disk>
Nov 08 18:35:16 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:35:16 user nova-compute[74820]:       <mac address="fa:16:3e:32:db:e6"/>
Nov 08 18:35:16 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:35:16 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:35:16 user nova-compute[74820]:       <target dev="tapd1bd3dc6-76"/>
Nov 08 18:35:16 user nova-compute[74820]:     </interface>
Nov 08 18:35:16 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:35:16 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/console.log" append="off"/>
Nov 08 18:35:16 user nova-compute[74820]:     </serial>
Nov 08 18:35:16 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:35:16 user nova-compute[74820]:     <video>
Nov 08 18:35:16 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:35:16 user nova-compute[74820]:     </video>
Nov 08 18:35:16 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:35:16 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:35:16 user nova-compute[74820]:     </rng>
Nov 08 18:35:16 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:35:16 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:35:16 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:35:16 user nova-compute[74820]:     </memballoon>
Nov 08 18:35:16 user nova-compute[74820]:   </devices>
Nov 08 18:35:16 user nova-compute[74820]: </domain>
Nov 08 18:35:16 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-683820164',display_name='tempest-ServersNegativeTestJSON-server-683820164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-683820164',id=21,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16d2eda9ff724b288680a1ac55e667ce',ramdisk_id='',reservation_id='r-yrc21b2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-816870962',owner_user_name='tempest-ServersNegativeTestJSON-816870962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:35:14Z,user_data=None,user_id='da2d9ad108da46cca9b8c5d870e8076d',uuid=fb521d9b-a6c2-4673-9a3f-33dde9b5b79e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converting VIF {"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG os_vif [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ea9e212-ad80-5f7d-9e0b-04bac7f3c60b', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1bd3dc6-76, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1bd3dc6-76, col_values=(('qos', UUID('1deb479b-0cb1-4f7b-b4d4-6ae22cf585fe')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1bd3dc6-76, col_values=(('external_ids', {'iface-id': 'd1bd3dc6-765e-404a-bbbc-41b704a03e77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:db:e6', 'vm-uuid': 'fb521d9b-a6c2-4673-9a3f-33dde9b5b79e'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:16 user nova-compute[74820]: INFO os_vif [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76')
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] No VIF found with MAC fa:16:3e:32:db:e6, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Updated VIF entry in instance network info cache for port d1bd3dc6-765e-404a-bbbc-41b704a03e77. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Updating instance_info_cache with network_info: [{"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-300bce77-3b8f-4126-9b2d-1f27040b5331 req-0180d254-95d4-487e-9c80-af3ec73769d3 service nova] Releasing lock "refresh_cache-fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-f481216b-7697-4ecf-8d89-9e99a47129ae req-100c056a-e34c-4ca3-9e7a-7b58ba7522f2 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Received event network-vif-plugged-d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f481216b-7697-4ecf-8d89-9e99a47129ae req-100c056a-e34c-4ca3-9e7a-7b58ba7522f2 service nova] Acquiring lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f481216b-7697-4ecf-8d89-9e99a47129ae req-100c056a-e34c-4ca3-9e7a-7b58ba7522f2 service nova] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f481216b-7697-4ecf-8d89-9e99a47129ae req-100c056a-e34c-4ca3-9e7a-7b58ba7522f2 service nova] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-f481216b-7697-4ecf-8d89-9e99a47129ae req-100c056a-e34c-4ca3-9e7a-7b58ba7522f2 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] No waiting events found dispatching network-vif-plugged-d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:35:18 user nova-compute[74820]: WARNING nova.compute.manager [req-f481216b-7697-4ecf-8d89-9e99a47129ae req-100c056a-e34c-4ca3-9e7a-7b58ba7522f2 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Received unexpected event network-vif-plugged-d1bd3dc6-765e-404a-bbbc-41b704a03e77 for instance with vm_state building and task_state spawning.
Nov 08 18:35:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-a362bdbe-6f1d-4ffe-8c31-0cc3460741dd req-a1ff4799-965d-449c-98f2-1b007d261b0f service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Received event network-vif-plugged-d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a362bdbe-6f1d-4ffe-8c31-0cc3460741dd req-a1ff4799-965d-449c-98f2-1b007d261b0f service nova] Acquiring lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a362bdbe-6f1d-4ffe-8c31-0cc3460741dd req-a1ff4799-965d-449c-98f2-1b007d261b0f service nova] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a362bdbe-6f1d-4ffe-8c31-0cc3460741dd req-a1ff4799-965d-449c-98f2-1b007d261b0f service nova] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-a362bdbe-6f1d-4ffe-8c31-0cc3460741dd req-a1ff4799-965d-449c-98f2-1b007d261b0f service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] No waiting events found dispatching network-vif-plugged-d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:35:20 user nova-compute[74820]: WARNING nova.compute.manager [req-a362bdbe-6f1d-4ffe-8c31-0cc3460741dd req-a1ff4799-965d-449c-98f2-1b007d261b0f service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Received unexpected event network-vif-plugged-d1bd3dc6-765e-404a-bbbc-41b704a03e77 for instance with vm_state building and task_state spawning.
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:35:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Instance spawned successfully.
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:35:20 user nova-compute[74820]: INFO nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 08 18:35:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:35:20 user nova-compute[74820]: INFO nova.compute.manager [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Took 7.37 seconds to build instance.
Nov 08 18:35:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f4240e58-1072-4b31-be14-74bce86a9ac9 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.547s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrmpCXkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:35:38 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:35:38 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:35:38 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0adc2f-2fbe-497b-9a07-b8ac454a7e36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:35:38 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6f2e27-fa56-4090-95b1-5554671ee34c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500] added
Nov 08 18:35:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[380dac0a-4f32-46bc-98cf-85e08d62346f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761e6c4-f2f1-441e-ae9f-95afdeff63d4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrmpCXkx {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrmpCXkx" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c9e27a-61fe-4c9f-8017-32ecabaa611b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrmpCXkx'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3b69c3-3c99-498f-aa63-ade7db43fac6]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adf7204-aced-4455-bb09-f332a107b154]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:35:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:35:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d84cb6b-d9a3-4780-adcf-148f6741b30e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260]
Nov 08 18:35:38 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260] successful.
Nov 08 18:35:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[422badb0-c248-4d70-809b-538897d3fec9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[14305485-9bb9-4f39-80d1-99aad3b2617e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:35:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 (non-flash)
Nov 08 18:35:38 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:35:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:35:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5eca3-0cb8-4d18-a3b4-c7a413272e99]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrmpCXkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23631643639653130', 'path': '/dev/sdf'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631643639653130', 'path': '/dev/sdf'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lazy-loading 'flavor' on Instance uuid 94bf2982-61c7-41a3-9aeb-3cc34cd3111b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:35:40 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:35:40 user nova-compute[74820]:   <source dev="/dev/sdf"/>
Nov 08 18:35:40 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:35:40 user nova-compute[74820]:   <serial>af45eb38-46f9-470e-ab55-5caaad980500</serial>
Nov 08 18:35:40 user nova-compute[74820]: </disk>
Nov 08 18:35:40 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] No VIF found with MAC fa:16:3e:cc:9c:8b, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:35:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-533b0322-7dce-42ba-981b-a1d1af76a804 tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.483s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:41 user nova-compute[74820]: INFO nova.compute.manager [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Terminating instance
Nov 08 18:35:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-41e26140-2f1e-45a1-b93a-9dfc8c4534ef req-812a7745-7431-42a9-a964-0dca0fd995f7 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-vif-unplugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-41e26140-2f1e-45a1-b93a-9dfc8c4534ef req-812a7745-7431-42a9-a964-0dca0fd995f7 service nova] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-41e26140-2f1e-45a1-b93a-9dfc8c4534ef req-812a7745-7431-42a9-a964-0dca0fd995f7 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-41e26140-2f1e-45a1-b93a-9dfc8c4534ef req-812a7745-7431-42a9-a964-0dca0fd995f7 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-41e26140-2f1e-45a1-b93a-9dfc8c4534ef req-812a7745-7431-42a9-a964-0dca0fd995f7 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] No waiting events found dispatching network-vif-unplugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-41e26140-2f1e-45a1-b93a-9dfc8c4534ef req-812a7745-7431-42a9-a964-0dca0fd995f7 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-vif-unplugged-c525187e-1024-4d85-9df9-4994592c71e2 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:35:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Instance destroyed successfully.
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.objects.instance [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lazy-loading 'resources' on Instance uuid 94bf2982-61c7-41a3-9aeb-3cc34cd3111b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-468023194',display_name='tempest-DeleteServersTestJSON-server-468023194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-468023194',id=16,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e940b0e1c9024ff79a1f32133f0865b6',ramdisk_id='',reservation_id='r-bg092gww',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-396242315',owner_user_name='tempest-DeleteServersTestJSON-396242315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:33:22Z,user_data=None,user_id='9aca49e4870243f1a18a42054edde453',uuid=94bf2982-61c7-41a3-9aeb-3cc34cd3111b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Converting VIF {"id": "c525187e-1024-4d85-9df9-4994592c71e2", "address": "fa:16:3e:cc:9c:8b", "network": {"id": "ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1389926158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e940b0e1c9024ff79a1f32133f0865b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc525187e-10", "ovs_interfaceid": "c525187e-1024-4d85-9df9-4994592c71e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_vif [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc525187e-10, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a07055c-1a1d-4246-98b4-2274ee1e6390) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: INFO os_vif [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:8b,bridge_name='br-int',has_traffic_filtering=True,id=c525187e-1024-4d85-9df9-4994592c71e2,network=Network(ecef1e9a-f5ea-4b2b-9cf2-af943fd2853b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc525187e-10')
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrmpCXkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:35:42 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f35251-62fa-4500-b3ca-386039ce37a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:35:42 user nova-compute[74820]: No targets found.
Nov 08 18:35:42 user nova-compute[74820]: iSNS:
Nov 08 18:35:42 user nova-compute[74820]: No targets found.
Nov 08 18:35:42 user nova-compute[74820]: STATIC:
Nov 08 18:35:42 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:35:42 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:35:42 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:35:42 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:35:42 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:35:42 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:35:42 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:35:42 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:35:42 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:35:42 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955
Nov 08 18:35:42 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:35:42 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:35:42 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500
Nov 08 18:35:42 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:35:42 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:35:42 user nova-compute[74820]: FIRMWARE:
Nov 08 18:35:42 user nova-compute[74820]: No targets found.
Nov 08 18:35:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:35:42 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:35:42 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeef777-3e45-49c6-8fc9-6f959d387a8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9deb5-b262-485e-b550-948b9b6b66e8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:35:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 (non-flash)
Nov 08 18:35:42 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:35:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e482af1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500'): ({'sdf'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Removing single pathed devices sdf {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b538c0e-dbbd-45d0-ae9e-3feb2ddd0b2d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5bede6-ba6b-4006-a04a-2380877247a9]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Flushing IO for device /dev/sdf {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0ba15d-4819-4ace-96a9-59e584c210bb]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f3c0f1-5513-4384-a76a-10a4876b0f91]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7ee8c-677b-40b0-9fac-2c08018ce69f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b648d4-5046-41c8-8608-82adf8a34da4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260]
Nov 08 18:35:42 user nova-compute[74820]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500, portal: 172.16.0.220,3260] successful.
Nov 08 18:35:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af45eb38-46f9-470e-ab55-5caaad980500 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34c998-57f1-4753-b476-a4ed318834d8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] <== disconnect_volume: return (368ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:35:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Deleting instance files /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b_del
Nov 08 18:35:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Deletion of /opt/stack/data/nova/instances/94bf2982-61c7-41a3-9aeb-3cc34cd3111b_del complete
Nov 08 18:35:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:42 user nova-compute[74820]: INFO nova.compute.manager [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 08 18:35:42 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:35:42 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:35:43 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:43 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Took 0.51 seconds to deallocate network for instance.
Nov 08 18:35:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:44 user nova-compute[74820]: INFO nova.compute.manager [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Took 0.97 seconds to detach 1 volumes for instance.
Nov 08 18:35:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] Acquiring lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] No waiting events found dispatching network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:35:44 user nova-compute[74820]: WARNING nova.compute.manager [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received unexpected event network-vif-plugged-c525187e-1024-4d85-9df9-4994592c71e2 for instance with vm_state active and task_state deleting.
Nov 08 18:35:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8b317be-cf61-4f35-a03b-43c2c1d3672c req-4e0accab-d10f-419c-9ef0-1e941a2b7671 service nova] [instance: 94bf2982-61c7-41a3-9aeb-3cc34cd3111b] Received event network-vif-deleted-c525187e-1024-4d85-9df9-4994592c71e2 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:35:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:45 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Deleted allocations for instance 94bf2982-61c7-41a3-9aeb-3cc34cd3111b
Nov 08 18:35:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-371f49b0-c92e-423b-b6c4-4958d56a8ffc tempest-DeleteServersTestJSON-396242315 tempest-DeleteServersTestJSON-396242315-project-member] Lock "94bf2982-61c7-41a3-9aeb-3cc34cd3111b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.484s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:35:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:35:48 user nova-compute[74820]: INFO nova.compute.claims [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Claim successful on node user
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.network.neutron [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:35:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG nova.policy [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d80baca13c04f37b8ea3d651536cdfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ad38240d754655a8f23b1dbc581507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:35:49 user nova-compute[74820]: INFO nova.virt.block_device [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Booting with volume snapshot d34c8421-9692-43b6-a723-4a0c85f7f81a at /dev/vda
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG nova.network.neutron [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Successfully created port: 75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:35:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Successfully updated port: 75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "refresh_cache-e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquired lock "refresh_cache-e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-changed-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Refreshing instance network info cache due to event network-changed-75f8c392-b792-41f4-8980-6dee8f615458. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] Acquiring lock "refresh_cache-e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Updating instance_info_cache with network_info: [{"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Releasing lock "refresh_cache-e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Instance network_info: |[{"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] Acquired lock "refresh_cache-e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Refreshing network info cache for port 75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Updated VIF entry in instance network info cache for port 75f8c392-b792-41f4-8980-6dee8f615458. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG nova.network.neutron [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Updating instance_info_cache with network_info: [{"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-940b3a31-d169-4455-88a9-8097f102c505 req-dd547925-7475-40c9-a2da-7c0f01186d66 service nova] Releasing lock "refresh_cache-e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:35:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7179MB free_disk=25.22610092163086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 490de0ea-289a-45aa-bb05-14fb138fb833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2c0484b3-8be4-430f-9436-1f2f095414f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d4bbc087-e9df-431d-9c42-9e10718e7e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance fb521d9b-a6c2-4673-9a3f-33dde9b5b79e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e6c0f58b-f65e-48bf-811b-ac3c1bc6456e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:35:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:53 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:35:53 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:35:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:35:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:35:54 user nova-compute[74820]: INFO nova.compute.manager [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Detaching volume 03083d2b-2659-45b7-b1fa-0568f7adb955
Nov 08 18:35:55 user nova-compute[74820]: INFO nova.virt.block_device [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Attempting to driver detach volume 03083d2b-2659-45b7-b1fa-0568f7adb955 from mountpoint /dev/vdb
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Attempting to detach device vdb from instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:35:55 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:35:55 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:35:55 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:35:55 user nova-compute[74820]:   <serial>03083d2b-2659-45b7-b1fa-0568f7adb955</serial>
Nov 08 18:35:55 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:35:55 user nova-compute[74820]: </disk>
Nov 08 18:35:55 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:35:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully detached device vdb from instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 from the persistent domain config.
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:35:55 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:35:55 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:35:55 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:35:55 user nova-compute[74820]:   <serial>03083d2b-2659-45b7-b1fa-0568f7adb955</serial>
Nov 08 18:35:55 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:35:55 user nova-compute[74820]: </disk>
Nov 08 18:35:55 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:35:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:35:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:35:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG os_brick.utils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d93eff5-6432-4c58-87f4-cb584aff7285]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00a6870-ba70-465f-896f-3558e43008cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e70669-d1da-462b-beee-1c607382ad30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[667ef562-4fba-4954-bb20-ac4ef77ea89d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:36:00 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:36:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02cd575-389b-40d0-9852-cfbecef15088]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG os_brick.utils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:36:00 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Updating existing volume attachment record: c2f93784-b057-45ed-a47e-01bddde34783 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:36:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:36:10 user nova-compute[74820]: INFO nova.compute.claims [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Claim successful on node user
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:36:10 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.policy [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5790613f8a24f52897aedd0634f7f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77a76c049904c6abe35b10929563c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:36:10 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Creating image(s)
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk 1073741824" returned: 0 in 0.054s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Successfully created port: 7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Cannot resize image /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Ensure instance console log exists: /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Successfully updated port: 7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-changed-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Refreshing instance network info cache due to event network-changed-7d35077a-01a8-483b-9fcc-0fc2e2af7bec. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] Acquiring lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Updating instance_info_cache with network_info: [{"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Instance network_info: |[{"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] Acquired lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Refreshing network info cache for port 7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Start _get_guest_xml network_info=[{"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:36:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:36:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1150862025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1150862025',id=23,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-yw7ej1op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:36:11Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=5ffeef93-63b0-4dab-a336-f2946b4cbae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.objects.instance [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ffeef93-63b0-4dab-a336-f2946b4cbae1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:36:12 user nova-compute[74820]:   <uuid>5ffeef93-63b0-4dab-a336-f2946b4cbae1</uuid>
Nov 08 18:36:12 user nova-compute[74820]:   <name>instance-00000017</name>
Nov 08 18:36:12 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:36:12 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:36:12 user nova-compute[74820]:   <metadata>
Nov 08 18:36:12 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:36:12 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:36:12 user nova-compute[74820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1150862025</nova:name>
Nov 08 18:36:12 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:36:12</nova:creationTime>
Nov 08 18:36:12 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:36:12 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:36:12 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:36:12 user nova-compute[74820]:       <nova:owner>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:user uuid="c5790613f8a24f52897aedd0634f7f7f">tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member</nova:user>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:project uuid="e77a76c049904c6abe35b10929563c00">tempest-ServerBootFromVolumeStableRescueTest-516881030</nova:project>
Nov 08 18:36:12 user nova-compute[74820]:       </nova:owner>
Nov 08 18:36:12 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:36:12 user nova-compute[74820]:       <nova:ports>
Nov 08 18:36:12 user nova-compute[74820]:         <nova:port uuid="7d35077a-01a8-483b-9fcc-0fc2e2af7bec">
Nov 08 18:36:12 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 18:36:12 user nova-compute[74820]:         </nova:port>
Nov 08 18:36:12 user nova-compute[74820]:       </nova:ports>
Nov 08 18:36:12 user nova-compute[74820]:     </nova:instance>
Nov 08 18:36:12 user nova-compute[74820]:   </metadata>
Nov 08 18:36:12 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:36:12 user nova-compute[74820]:     <system>
Nov 08 18:36:12 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:36:12 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:36:12 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:36:12 user nova-compute[74820]:       <entry name="serial">5ffeef93-63b0-4dab-a336-f2946b4cbae1</entry>
Nov 08 18:36:12 user nova-compute[74820]:       <entry name="uuid">5ffeef93-63b0-4dab-a336-f2946b4cbae1</entry>
Nov 08 18:36:12 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:36:12 user nova-compute[74820]:     </system>
Nov 08 18:36:12 user nova-compute[74820]:   </sysinfo>
Nov 08 18:36:12 user nova-compute[74820]:   <os>
Nov 08 18:36:12 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:36:12 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:36:12 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:36:12 user nova-compute[74820]:   </os>
Nov 08 18:36:12 user nova-compute[74820]:   <features>
Nov 08 18:36:12 user nova-compute[74820]:     <acpi/>
Nov 08 18:36:12 user nova-compute[74820]:     <apic/>
Nov 08 18:36:12 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:36:12 user nova-compute[74820]:   </features>
Nov 08 18:36:12 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:36:12 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:36:12 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:36:12 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:36:12 user nova-compute[74820]:   </clock>
Nov 08 18:36:12 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:36:12 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:36:12 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:36:12 user nova-compute[74820]:   </cpu>
Nov 08 18:36:12 user nova-compute[74820]:   <devices>
Nov 08 18:36:12 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:36:12 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:36:12 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk"/>
Nov 08 18:36:12 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:36:12 user nova-compute[74820]:     </disk>
Nov 08 18:36:12 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:36:12 user nova-compute[74820]:       <mac address="fa:16:3e:b3:05:f4"/>
Nov 08 18:36:12 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:36:12 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:36:12 user nova-compute[74820]:       <target dev="tap7d35077a-01"/>
Nov 08 18:36:12 user nova-compute[74820]:     </interface>
Nov 08 18:36:12 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:36:12 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/console.log" append="off"/>
Nov 08 18:36:12 user nova-compute[74820]:     </serial>
Nov 08 18:36:12 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:36:12 user nova-compute[74820]:     <video>
Nov 08 18:36:12 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:36:12 user nova-compute[74820]:     </video>
Nov 08 18:36:12 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:36:12 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:36:12 user nova-compute[74820]:     </rng>
Nov 08 18:36:12 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:36:12 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:36:12 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:36:12 user nova-compute[74820]:     </memballoon>
Nov 08 18:36:12 user nova-compute[74820]:   </devices>
Nov 08 18:36:12 user nova-compute[74820]: </domain>
Nov 08 18:36:12 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:36:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1150862025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1150862025',id=23,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-yw7ej1op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:36:11Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=5ffeef93-63b0-4dab-a336-f2946b4cbae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG os_vif [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd83f8527-a912-5def-b677-406313024bdc', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d35077a-01, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d35077a-01, col_values=(('qos', UUID('0336815b-1fd3-4350-8edd-5e559bc20c92')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d35077a-01, col_values=(('external_ids', {'iface-id': '7d35077a-01a8-483b-9fcc-0fc2e2af7bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:05:f4', 'vm-uuid': '5ffeef93-63b0-4dab-a336-f2946b4cbae1'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:12 user nova-compute[74820]: INFO os_vif [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01')
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No VIF found with MAC fa:16:3e:b3:05:f4, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Updated VIF entry in instance network info cache for port 7d35077a-01a8-483b-9fcc-0fc2e2af7bec. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Updating instance_info_cache with network_info: [{"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-449d5d8d-7745-4c93-96a7-da236c5b8569 req-80c6fcd4-8e31-4b32-a09f-af807d71bce4 service nova] Releasing lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:13 user nova-compute[74820]: INFO nova.compute.manager [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Detaching volume 12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:36:13 user nova-compute[74820]: INFO nova.virt.block_device [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Attempting to driver detach volume 12e4ae67-651f-4d37-9772-31e29bf263c0 from mountpoint /dev/vdb
Nov 08 18:36:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Attempting to detach device vdb from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:36:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:36:13 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:36:13 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:36:13 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:36:13 user nova-compute[74820]:   <serial>12e4ae67-651f-4d37-9772-31e29bf263c0</serial>
Nov 08 18:36:13 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 18:36:13 user nova-compute[74820]: </disk>
Nov 08 18:36:13 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:36:13 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully detached device vdb from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f from the persistent domain config.
Nov 08 18:36:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:36:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:36:13 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:36:13 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:36:13 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:36:13 user nova-compute[74820]:   <serial>12e4ae67-651f-4d37-9772-31e29bf263c0</serial>
Nov 08 18:36:13 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 18:36:13 user nova-compute[74820]: </disk>
Nov 08 18:36:13 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-f3ef0dde-5736-4071-9d83-3b6b4d31fb88 req-f049bf31-fa15-4b6a-a26f-ebd69abaee32 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f3ef0dde-5736-4071-9d83-3b6b4d31fb88 req-f049bf31-fa15-4b6a-a26f-ebd69abaee32 service nova] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f3ef0dde-5736-4071-9d83-3b6b4d31fb88 req-f049bf31-fa15-4b6a-a26f-ebd69abaee32 service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f3ef0dde-5736-4071-9d83-3b6b4d31fb88 req-f049bf31-fa15-4b6a-a26f-ebd69abaee32 service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-f3ef0dde-5736-4071-9d83-3b6b4d31fb88 req-f049bf31-fa15-4b6a-a26f-ebd69abaee32 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] No waiting events found dispatching network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:14 user nova-compute[74820]: WARNING nova.compute.manager [req-f3ef0dde-5736-4071-9d83-3b6b4d31fb88 req-f049bf31-fa15-4b6a-a26f-ebd69abaee32 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received unexpected event network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec for instance with vm_state building and task_state spawning.
Nov 08 18:36:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 is timed out.
Nov 08 18:36:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully detached device vdb from instance 3193361a-b8aa-4d53-a7ef-7bb70af53303 from the live domain config.
Nov 08 18:36:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOuzAypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:36:15 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a8206-ff81-4d5a-8ef7-f0a2f929c3b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:36:15 user nova-compute[74820]: No targets found.
Nov 08 18:36:15 user nova-compute[74820]: iSNS:
Nov 08 18:36:15 user nova-compute[74820]: No targets found.
Nov 08 18:36:15 user nova-compute[74820]: STATIC:
Nov 08 18:36:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:36:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:36:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:36:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:15 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955
Nov 08 18:36:15 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:15 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:15 user nova-compute[74820]: FIRMWARE:
Nov 08 18:36:15 user nova-compute[74820]: No targets found.
Nov 08 18:36:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:36:15 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:36:15 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73caa987-f864-4a80-b9b8-5e849ec4bd30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6bce6a-908a-43e1-8ec5-080dd78629ea]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:15 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:15 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:36:15 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:15 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:15 user nova-compute[74820]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 (non-flash)
Nov 08 18:36:15 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c48c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cce4840-ccc7-438c-8f7f-ed47599e321e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcae452-3193-4194-a02e-1bd8b43d83a8]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf72f8-3c43-454c-b8fc-ab91dee829b3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1529651-5f1e-4227-bdb5-2baf96d036e1]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e3146f-fb95-4a6f-98bc-4e84d645bdb5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ea227-6fa6-407c-b736-379f24004426]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260]
Nov 08 18:36:15 user nova-compute[74820]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955, portal: 172.16.0.220,3260] successful.
Nov 08 18:36:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e095c-0540-468d-8a48-5c9036848915]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== disconnect_volume: return (326ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:36:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:36:16 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Instance spawned successfully.
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:16 user nova-compute[74820]: INFO nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:36:16 user nova-compute[74820]: INFO nova.compute.manager [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Took 6.61 seconds to build instance.
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-fe3101c9-be22-4f70-892f-84dca28eb561 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.702s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'flavor' on Instance uuid 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-28f812da-c7a4-4d46-bed6-2f41d091f836 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.796s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:16 user nova-compute[74820]: INFO nova.compute.manager [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Terminating instance
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-30dfb9da-7e24-4cdc-899f-c7be25b58add req-b76a7869-f95d-4a7e-8357-2cdce1b728de service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-30dfb9da-7e24-4cdc-899f-c7be25b58add req-b76a7869-f95d-4a7e-8357-2cdce1b728de service nova] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-30dfb9da-7e24-4cdc-899f-c7be25b58add req-b76a7869-f95d-4a7e-8357-2cdce1b728de service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-30dfb9da-7e24-4cdc-899f-c7be25b58add req-b76a7869-f95d-4a7e-8357-2cdce1b728de service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-30dfb9da-7e24-4cdc-899f-c7be25b58add req-b76a7869-f95d-4a7e-8357-2cdce1b728de service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] No waiting events found dispatching network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:17 user nova-compute[74820]: WARNING nova.compute.manager [req-30dfb9da-7e24-4cdc-899f-c7be25b58add req-b76a7869-f95d-4a7e-8357-2cdce1b728de service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received unexpected event network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec for instance with vm_state active and task_state None.
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-35705978-b4ab-493a-8cf7-c38f9cef6b31 req-a836ca2c-bac9-4782-bbff-6873422714d2 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-vif-unplugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-35705978-b4ab-493a-8cf7-c38f9cef6b31 req-a836ca2c-bac9-4782-bbff-6873422714d2 service nova] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-35705978-b4ab-493a-8cf7-c38f9cef6b31 req-a836ca2c-bac9-4782-bbff-6873422714d2 service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-35705978-b4ab-493a-8cf7-c38f9cef6b31 req-a836ca2c-bac9-4782-bbff-6873422714d2 service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-35705978-b4ab-493a-8cf7-c38f9cef6b31 req-a836ca2c-bac9-4782-bbff-6873422714d2 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] No waiting events found dispatching network-vif-unplugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-35705978-b4ab-493a-8cf7-c38f9cef6b31 req-a836ca2c-bac9-4782-bbff-6873422714d2 service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-vif-unplugged-08ae7236-8687-44f7-aa2f-769b535110cd for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Instance destroyed successfully.
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'resources' on Instance uuid 3193361a-b8aa-4d53-a7ef-7bb70af53303 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1093161186',display_name='tempest-VolumesSnapshotTestJSON-instance-1093161186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1093161186',id=15,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhEZaXxZId5OxEoL0tz8ndlytEpKzD4qaRCQ6MvLapAr3JJ65zIhMDKE5XajSI+OU0HnEUQmNjGJ5KHQqXI0FZzapvRfHjT4y43I5Bkm69TH4swOBVvQQ94H5EjLx9ysw==',key_name='tempest-keypair-818155430',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:32:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53f1ade1323846c39c48886010ea85e9',ramdisk_id='',reservation_id='r-9kaqfb19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1628967070',owner_user_name='tempest-VolumesSnapshotTestJSON-1628967070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23005c9177444a5da028f8f60202e1fc',uuid=3193361a-b8aa-4d53-a7ef-7bb70af53303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converting VIF {"id": "08ae7236-8687-44f7-aa2f-769b535110cd", "address": "fa:16:3e:fb:68:7a", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08ae7236-86", "ovs_interfaceid": "08ae7236-8687-44f7-aa2f-769b535110cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_vif [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08ae7236-86, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82bd082a-b172-4671-989e-6fc7f66e3b34) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:17 user nova-compute[74820]: INFO os_vif [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:68:7a,bridge_name='br-int',has_traffic_filtering=True,id=08ae7236-8687-44f7-aa2f-769b535110cd,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08ae7236-86')
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOuzAypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:36:17 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a77fcca-7742-4d9e-88e1-ae53e267935f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:36:17 user nova-compute[74820]: No targets found.
Nov 08 18:36:17 user nova-compute[74820]: iSNS:
Nov 08 18:36:17 user nova-compute[74820]: No targets found.
Nov 08 18:36:17 user nova-compute[74820]: STATIC:
Nov 08 18:36:17 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:36:17 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:17 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:17 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:36:17 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:17 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:17 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:36:17 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:17 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:17 user nova-compute[74820]: FIRMWARE:
Nov 08 18:36:17 user nova-compute[74820]: No targets found.
Nov 08 18:36:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:36:17 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:36:17 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03083d2b-2659-45b7-b1fa-0568f7adb955', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f32eba-1d8d-4569-9d53-063aca146df0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[617d6a54-b3cf-4e8a-b590-2f855b536031]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:17 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:17 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:17 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:17 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e40382d40>, {}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Disconnecting from: [] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== disconnect_volume: return (83ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:36:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:36:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Deleting instance files /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303_del
Nov 08 18:36:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Deletion of /opt/stack/data/nova/instances/3193361a-b8aa-4d53-a7ef-7bb70af53303_del complete
Nov 08 18:36:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:18 user nova-compute[74820]: INFO nova.compute.manager [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 08 18:36:18 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:36:18 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:36:18 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:36:18 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:18 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Took 0.84 seconds to deallocate network for instance.
Nov 08 18:36:18 user nova-compute[74820]: WARNING nova.volume.cinder [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Attachment ead806b4-f959-4750-9527-a37f5f30982e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ead806b4-f959-4750-9527-a37f5f30982e. (HTTP 404) (Request-ID: req-82384398-1a76-4106-b230-670750757109)
Nov 08 18:36:18 user nova-compute[74820]: INFO nova.compute.manager [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Took 0.04 seconds to detach 1 volumes for instance.
Nov 08 18:36:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] Acquiring lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] No waiting events found dispatching network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:19 user nova-compute[74820]: WARNING nova.compute.manager [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received unexpected event network-vif-plugged-08ae7236-8687-44f7-aa2f-769b535110cd for instance with vm_state deleted and task_state None.
Nov 08 18:36:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-b5d79cdc-f788-41ab-83a9-7f212406a960 req-9cee80ac-c81a-4090-a92a-39477659106a service nova] [instance: 3193361a-b8aa-4d53-a7ef-7bb70af53303] Received event network-vif-deleted-08ae7236-8687-44f7-aa2f-769b535110cd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:36:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:19 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Deleted allocations for instance 3193361a-b8aa-4d53-a7ef-7bb70af53303
Nov 08 18:36:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07ca78dc-e365-433f-b3d9-545118b321d8 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "3193361a-b8aa-4d53-a7ef-7bb70af53303" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.646s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-changed-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Refreshing instance network info cache due to event network-changed-df8c6068-1bc4-4305-8774-c7f031143636. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] Acquiring lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] Acquired lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Refreshing network info cache for port df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updated VIF entry in instance network info cache for port df8c6068-1bc4-4305-8774-c7f031143636. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updating instance_info_cache with network_info: [{"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec8d7186-666a-4429-b02b-ecc81d5d2256 req-11249f17-5ff3-4812-ae24-c0d3d702b2c5 service nova] Releasing lock "refresh_cache-490de0ea-289a-45aa-bb05-14fb138fb833" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:36:25 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Creating image(s)
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Ensure instance console log exists: /opt/stack/data/nova/instances/e6c0f58b-f65e-48bf-811b-ac3c1bc6456e/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Start _get_guest_xml network_info=[{"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'c2f93784-b057-45ed-a47e-01bddde34783', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FopDqTEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6c0f58b-f65e-48bf-811b-ac3c1bc6456e', 'attached_at': '', 'detached_at': '', 'volume_id': '49fd4908-00de-4112-9eb0-1ff114e94ce1', 'serial': '49fd4908-00de-4112-9eb0-1ff114e94ce1'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:36:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:36:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:36:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FopDqTEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:36:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:36:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:36:26 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a36cc-4394-4516-9bfd-78bc2541c1be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:36:26 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca9c05-04cf-4d2a-aaaf-331b11e45f96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1] added
Nov 08 18:36:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d7f27-e3d5-4e67-b628-7f6f0ad7afa8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d2fca-0357-46d6-bb8f-36f69d12e52e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FopDqTEH {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FopDqTEH" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[229cd3d9-c386-4601-ac91-1c9f924a716c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FopDqTEH'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8203ba0-4ea8-4b66-bcdf-61c13dd426ce]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d082db-682d-4d5b-a3df-a176aaec7581]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e0118-6fe1-4bdf-b438-9568dfc52189]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260]
Nov 08 18:36:26 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260] successful.
Nov 08 18:36:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[225ec019-12c7-413f-8b78-2605d07df4d0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1e396-f4ef-4ada-a510-86a61395f08f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:36:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb35f8-738a-4b87-93e7-636d966ff8a1]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:36:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FopDqTEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '26136393032323338', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136393032323338', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1362727159',display_name='tempest-TestVolumeBootPattern-server-1362727159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1362727159',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-u10qtrcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:35:50Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=e6c0f58b-f65e-48bf-811b-ac3c1bc6456e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'pci_devices' on Instance uuid e6c0f58b-f65e-48bf-811b-ac3c1bc6456e {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:36:27 user nova-compute[74820]:   <uuid>e6c0f58b-f65e-48bf-811b-ac3c1bc6456e</uuid>
Nov 08 18:36:27 user nova-compute[74820]:   <name>instance-00000016</name>
Nov 08 18:36:27 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:36:27 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:36:27 user nova-compute[74820]:   <metadata>
Nov 08 18:36:27 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:36:27 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:36:27 user nova-compute[74820]:       <nova:name>tempest-TestVolumeBootPattern-server-1362727159</nova:name>
Nov 08 18:36:27 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:36:25</nova:creationTime>
Nov 08 18:36:27 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:36:27 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:36:27 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:36:27 user nova-compute[74820]:       <nova:owner>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:user uuid="4d80baca13c04f37b8ea3d651536cdfd">tempest-TestVolumeBootPattern-1148056077-project-member</nova:user>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:project uuid="f2ad38240d754655a8f23b1dbc581507">tempest-TestVolumeBootPattern-1148056077</nova:project>
Nov 08 18:36:27 user nova-compute[74820]:       </nova:owner>
Nov 08 18:36:27 user nova-compute[74820]:       <nova:ports>
Nov 08 18:36:27 user nova-compute[74820]:         <nova:port uuid="75f8c392-b792-41f4-8980-6dee8f615458">
Nov 08 18:36:27 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 18:36:27 user nova-compute[74820]:         </nova:port>
Nov 08 18:36:27 user nova-compute[74820]:       </nova:ports>
Nov 08 18:36:27 user nova-compute[74820]:     </nova:instance>
Nov 08 18:36:27 user nova-compute[74820]:   </metadata>
Nov 08 18:36:27 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:36:27 user nova-compute[74820]:     <system>
Nov 08 18:36:27 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:36:27 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:36:27 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:36:27 user nova-compute[74820]:       <entry name="serial">e6c0f58b-f65e-48bf-811b-ac3c1bc6456e</entry>
Nov 08 18:36:27 user nova-compute[74820]:       <entry name="uuid">e6c0f58b-f65e-48bf-811b-ac3c1bc6456e</entry>
Nov 08 18:36:27 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:36:27 user nova-compute[74820]:     </system>
Nov 08 18:36:27 user nova-compute[74820]:   </sysinfo>
Nov 08 18:36:27 user nova-compute[74820]:   <os>
Nov 08 18:36:27 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:36:27 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:36:27 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:36:27 user nova-compute[74820]:   </os>
Nov 08 18:36:27 user nova-compute[74820]:   <features>
Nov 08 18:36:27 user nova-compute[74820]:     <acpi/>
Nov 08 18:36:27 user nova-compute[74820]:     <apic/>
Nov 08 18:36:27 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:36:27 user nova-compute[74820]:   </features>
Nov 08 18:36:27 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:36:27 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:36:27 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:36:27 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:36:27 user nova-compute[74820]:   </clock>
Nov 08 18:36:27 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:36:27 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:36:27 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:36:27 user nova-compute[74820]:   </cpu>
Nov 08 18:36:27 user nova-compute[74820]:   <devices>
Nov 08 18:36:27 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:36:27 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:36:27 user nova-compute[74820]:       <source dev="/dev/sde"/>
Nov 08 18:36:27 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:36:27 user nova-compute[74820]:       <serial>49fd4908-00de-4112-9eb0-1ff114e94ce1</serial>
Nov 08 18:36:27 user nova-compute[74820]:     </disk>
Nov 08 18:36:27 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:36:27 user nova-compute[74820]:       <mac address="fa:16:3e:5a:e2:d0"/>
Nov 08 18:36:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:36:27 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:36:27 user nova-compute[74820]:       <target dev="tap75f8c392-b7"/>
Nov 08 18:36:27 user nova-compute[74820]:     </interface>
Nov 08 18:36:27 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:36:27 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/e6c0f58b-f65e-48bf-811b-ac3c1bc6456e/console.log" append="off"/>
Nov 08 18:36:27 user nova-compute[74820]:     </serial>
Nov 08 18:36:27 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:36:27 user nova-compute[74820]:     <video>
Nov 08 18:36:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:36:27 user nova-compute[74820]:     </video>
Nov 08 18:36:27 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:36:27 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:36:27 user nova-compute[74820]:     </rng>
Nov 08 18:36:27 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:36:27 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:36:27 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:36:27 user nova-compute[74820]:     </memballoon>
Nov 08 18:36:27 user nova-compute[74820]:   </devices>
Nov 08 18:36:27 user nova-compute[74820]: </domain>
Nov 08 18:36:27 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1362727159',display_name='tempest-TestVolumeBootPattern-server-1362727159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1362727159',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-u10qtrcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:35:50Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=e6c0f58b-f65e-48bf-811b-ac3c1bc6456e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG os_vif [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bc8766d-986f-55d5-bded-35cf9299c029', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75f8c392-b7, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75f8c392-b7, col_values=(('qos', UUID('2a4aa083-6c88-437a-a7f9-823d9e6a9651')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75f8c392-b7, col_values=(('external_ids', {'iface-id': '75f8c392-b792-41f4-8980-6dee8f615458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:e2:d0', 'vm-uuid': 'e6c0f58b-f65e-48bf-811b-ac3c1bc6456e'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:27 user nova-compute[74820]: INFO os_vif [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7')
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No VIF found with MAC fa:16:3e:5a:e2:d0, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:36:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-5e8ed14a-2b96-484f-b73a-0bfbc8668725 req-b0936822-7e13-4e07-84bd-65cb02d8227f service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5e8ed14a-2b96-484f-b73a-0bfbc8668725 req-b0936822-7e13-4e07-84bd-65cb02d8227f service nova] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5e8ed14a-2b96-484f-b73a-0bfbc8668725 req-b0936822-7e13-4e07-84bd-65cb02d8227f service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5e8ed14a-2b96-484f-b73a-0bfbc8668725 req-b0936822-7e13-4e07-84bd-65cb02d8227f service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-5e8ed14a-2b96-484f-b73a-0bfbc8668725 req-b0936822-7e13-4e07-84bd-65cb02d8227f service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] No waiting events found dispatching network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:29 user nova-compute[74820]: WARNING nova.compute.manager [req-5e8ed14a-2b96-484f-b73a-0bfbc8668725 req-b0936822-7e13-4e07-84bd-65cb02d8227f service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received unexpected event network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 for instance with vm_state building and task_state spawning.
Nov 08 18:36:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing instance network info cache due to event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG nova.network.neutron [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:30 user nova-compute[74820]: DEBUG nova.network.neutron [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updated VIF entry in instance network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:36:30 user nova-compute[74820]: DEBUG nova.network.neutron [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-896fd59f-4e03-40d4-87ef-a40498d76fa6 req-780dcbc1-f9a1-4d41-96d0-7817f29b4f9a service nova] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:36:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Instance spawned successfully.
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-0e385d0d-31aa-4d56-b9a0-6d8975bedbd2 req-e8c41515-a26a-4a33-808d-385f194c5b04 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0e385d0d-31aa-4d56-b9a0-6d8975bedbd2 req-e8c41515-a26a-4a33-808d-385f194c5b04 service nova] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0e385d0d-31aa-4d56-b9a0-6d8975bedbd2 req-e8c41515-a26a-4a33-808d-385f194c5b04 service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0e385d0d-31aa-4d56-b9a0-6d8975bedbd2 req-e8c41515-a26a-4a33-808d-385f194c5b04 service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-0e385d0d-31aa-4d56-b9a0-6d8975bedbd2 req-e8c41515-a26a-4a33-808d-385f194c5b04 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] No waiting events found dispatching network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:31 user nova-compute[74820]: WARNING nova.compute.manager [req-0e385d0d-31aa-4d56-b9a0-6d8975bedbd2 req-e8c41515-a26a-4a33-808d-385f194c5b04 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received unexpected event network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 for instance with vm_state building and task_state spawning.
Nov 08 18:36:31 user nova-compute[74820]: INFO nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 08 18:36:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:36:31 user nova-compute[74820]: INFO nova.compute.manager [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Took 42.84 seconds to build instance.
Nov 08 18:36:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-34f248a9-9f3a-467b-8bf5-9f75297be8c1 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.980s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid 490de0ea-289a-45aa-bb05-14fb138fb833 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:32 user nova-compute[74820]: INFO nova.compute.manager [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Attaching volume 79009a99-0e3b-4a21-b705-a2c4549c99f7 to /dev/vdb
Nov 08 18:36:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da3192-cc94-454d-a547-de2db9075770]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f14453-785b-4935-bb96-e5d2c4d88edb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f68906-49db-450f-a6e0-737c2c9e5910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae3f4f-8c54-4aa4-8017-f63ff21dcfdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:36:32 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:36:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[305da2c9-71e0-450c-868d-f9c76c8abd7b]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updating existing volume attachment record: 1b0b11df-3989-4350-ae1e-00a697965042 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:36:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:34 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f is timed out.
Nov 08 18:36:34 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully detached device vdb from instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f from the live domain config.
Nov 08 18:36:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvlOPApb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:36:34 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24f4791-6b6a-41dd-815e-feb9850d221f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:36:34 user nova-compute[74820]: No targets found.
Nov 08 18:36:34 user nova-compute[74820]: iSNS:
Nov 08 18:36:34 user nova-compute[74820]: No targets found.
Nov 08 18:36:34 user nova-compute[74820]: STATIC:
Nov 08 18:36:34 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0
Nov 08 18:36:34 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:34 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:34 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:36:34 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:34 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:34 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:36:34 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:34 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:34 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1
Nov 08 18:36:34 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:36:34 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:36:34 user nova-compute[74820]: FIRMWARE:
Nov 08 18:36:34 user nova-compute[74820]: No targets found.
Nov 08 18:36:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:36:34 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:36:34 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e49f1d-ee4a-4d30-af89-5e5165d57ae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c1897-14db-45f5-99f8-a74dad8dd547]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:34 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:34 user nova-compute[74820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:36:34 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 (non-flash)
Nov 08 18:36:34 user nova-compute[74820]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:36:34 user nova-compute[74820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:36:34 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:36:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e287e8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e2163-3363-4e04-ba2e-911a68b0572e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776892e-21b4-4c4c-9ee2-f324ab22f69b]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24dd19e-cb5c-41a7-aca4-7ffa1e41bc64]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbdb88-1b25-4606-9319-459f503b772f]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[76684d2b-bf2d-436b-b6c2-c953a5500fbd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7789eb-d7eb-49bb-bb4c-d64196b63d4d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260]
Nov 08 18:36:34 user nova-compute[74820]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0, portal: 172.16.0.220,3260] successful.
Nov 08 18:36:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12e4ae67-651f-4d37-9772-31e29bf263c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de87d5e-3dd2-454d-8a39-a13e2c68cf78]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== disconnect_volume: return (377ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:36:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:36:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:38 user nova-compute[74820]: INFO nova.compute.manager [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Shelving
Nov 08 18:36:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-f2b83df8-dbdb-4d6f-876f-b66c4aedb182 req-bcbb9ed0-3bc2-44ad-aa51-f0221fe4a246 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-unplugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f2b83df8-dbdb-4d6f-876f-b66c4aedb182 req-bcbb9ed0-3bc2-44ad-aa51-f0221fe4a246 service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f2b83df8-dbdb-4d6f-876f-b66c4aedb182 req-bcbb9ed0-3bc2-44ad-aa51-f0221fe4a246 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f2b83df8-dbdb-4d6f-876f-b66c4aedb182 req-bcbb9ed0-3bc2-44ad-aa51-f0221fe4a246 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-f2b83df8-dbdb-4d6f-876f-b66c4aedb182 req-bcbb9ed0-3bc2-44ad-aa51-f0221fe4a246 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-unplugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:39 user nova-compute[74820]: WARNING nova.compute.manager [req-f2b83df8-dbdb-4d6f-876f-b66c4aedb182 req-bcbb9ed0-3bc2-44ad-aa51-f0221fe4a246 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-unplugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state active and task_state shelving.
Nov 08 18:36:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance destroyed successfully.
Nov 08 18:36:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Beginning cold snapshot process
Nov 08 18:36:39 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:36:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk /opt/stack/data/nova/instances/snapshots/tmpuqws4d3f/644401abb1a04d55b0a7034a09668278 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk /opt/stack/data/nova/instances/snapshots/tmpuqws4d3f/644401abb1a04d55b0a7034a09668278" returned: 0 in 1.096s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Snapshot extracted, beginning image upload
Nov 08 18:36:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-7c07815f-f54f-49e8-8ab3-f096d5a6e04d req-dfb16ed6-1530-4a63-bdd4-70229199d4fe service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7c07815f-f54f-49e8-8ab3-f096d5a6e04d req-dfb16ed6-1530-4a63-bdd4-70229199d4fe service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7c07815f-f54f-49e8-8ab3-f096d5a6e04d req-dfb16ed6-1530-4a63-bdd4-70229199d4fe service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7c07815f-f54f-49e8-8ab3-f096d5a6e04d req-dfb16ed6-1530-4a63-bdd4-70229199d4fe service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-7c07815f-f54f-49e8-8ab3-f096d5a6e04d req-dfb16ed6-1530-4a63-bdd4-70229199d4fe service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:36:41 user nova-compute[74820]: WARNING nova.compute.manager [req-7c07815f-f54f-49e8-8ab3-f096d5a6e04d req-dfb16ed6-1530-4a63-bdd4-70229199d4fe service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 18:36:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Snapshot image upload complete
Nov 08 18:36:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:36:44 user nova-compute[74820]: INFO nova.compute.manager [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Shelve offloading
Nov 08 18:36:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance destroyed successfully.
Nov 08 18:36:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:36:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:36:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance destroyed successfully.
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'resources' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-672706708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-672706708',id=19,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeLu4U4L/nu4w3Uc7Um1BOuM1F3kA/OXwZyWRqqh9o3mYLxOrgGDWs85OnJTRDpbbjY/NhHJY6FDRaCDLZDsO/TmP3WWpBN6cTir9wTkID2/xs8OZJgEvde2BURzWe0UA==',key_name='tempest-keypair-1190867603',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-mkchcuj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member',shelved_at='2023-11-08T18:36:43.958643',shelved_host='user',shelved_image_id='9e29a40b-f071-4d70-bc8f-9f5903a43d77'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=2c0484b3-8be4-430f-9436-1f2f095414f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG os_vif [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap784a7f5c-9e, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9cde53e-6c32-45aa-b0bf-e964b4563260) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:36:45 user nova-compute[74820]: INFO os_vif [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e')
Nov 08 18:36:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Deleting instance files /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7_del
Nov 08 18:36:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Deletion of /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7_del complete
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing instance network info cache due to event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:36:45 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Deleted allocations for instance 2c0484b3-8be4-430f-9436-1f2f095414f7
Nov 08 18:36:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.objects.base [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<2c0484b3-8be4-430f-9436-1f2f095414f7> lazy-loaded attributes: resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updated VIF entry in instance network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-522e90ac-619f-486e-baf2-63695206fb67 req-c756e5c7-ac7d-4c4d-9fcb-ef8dccba901a service nova] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:36:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e51937a3-ab22-4c1a-94e9-8828d503138e tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.553s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'flavor' on Instance uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7e6ae305-2911-4584-abc7-722a4270be69 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.450s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:36:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.volume.cinder [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Update attachment failed for attachment 1b0b11df-3989-4350-ae1e-00a697965042. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ac3e4676-e0ca-4bf0-b1fa-3041f4fc69b8) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ac3e4676-e0ca-4bf0-b1fa-3041f4fc69b8)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Failed to attach 79009a99-0e3b-4a21-b705-a2c4549c99f7 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ac3e4676-e0ca-4bf0-b1fa-3041f4fc69b8)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Traceback (most recent call last):
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     self._do_attach(context, instance, volume, volume_api,
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     self._volume_attach(context, volume, connector, instance,
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     connection_info = volume_api.attachment_update(
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     res = method(self, ctx, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     with excutils.save_and_reraise_exception():
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     self.force_reraise()
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     raise self.value
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     return method.func(obj, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     resp = self._update('/attachments/%s' % id, body)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     return self.request(url, method, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833]     raise exceptions.from_response(resp, body)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ac3e4676-e0ca-4bf0-b1fa-3041f4fc69b8)
Nov 08 18:36:48 user nova-compute[74820]: ERROR nova.compute.manager [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] 
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.149s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server [None req-3a560a27-b3e8-47ea-a686-9431a131bde5 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ac3e4676-e0ca-4bf0-b1fa-3041f4fc69b8)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ac3e4676-e0ca-4bf0-b1fa-3041f4fc69b8)
Nov 08 18:36:48 user nova-compute[74820]: ERROR oslo_messaging.rpc.server 
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:36:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:36:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:36:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7325MB free_disk=25.191146850585938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a19102f1-af5a-4cb1-876f-8d053abed70b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 490de0ea-289a-45aa-bb05-14fb138fb833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d4bbc087-e9df-431d-9c42-9e10718e7e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance fb521d9b-a6c2-4673-9a3f-33dde9b5b79e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e6c0f58b-f65e-48bf-811b-ac3c1bc6456e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:36:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:36:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:36:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:36:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:36:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [{"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-a19102f1-af5a-4cb1-876f-8d053abed70b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-changed-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Refreshing instance network info cache due to event network-changed-8f2a7475-5e7a-4084-9686-9e7ba1e43262. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] Acquiring lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] Acquired lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG nova.network.neutron [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Refreshing network info cache for port 8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:36:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:36:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updated VIF entry in instance network info cache for port 8f2a7475-5e7a-4084-9686-9e7ba1e43262. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:36:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updating instance_info_cache with network_info: [{"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:36:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-07a49390-5223-4649-9cd8-d44bd9bdb284 req-f2dc06d3-7b30-495e-8daa-45bfcf21962d service nova] Releasing lock "refresh_cache-d4bbc087-e9df-431d-9c42-9e10718e7e6d" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:36:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:03 user nova-compute[74820]: INFO nova.compute.manager [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Terminating instance
Nov 08 18:37:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Instance destroyed successfully.
Nov 08 18:37:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lazy-loading 'resources' on Instance uuid fb521d9b-a6c2-4673-9a3f-33dde9b5b79e {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-683820164',display_name='tempest-ServersNegativeTestJSON-server-683820164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-683820164',id=21,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16d2eda9ff724b288680a1ac55e667ce',ramdisk_id='',reservation_id='r-yrc21b2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-816870962',owner_user_name='tempest-ServersNegativeTestJSON-816870962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:35:21Z,user_data=None,user_id='da2d9ad108da46cca9b8c5d870e8076d',uuid=fb521d9b-a6c2-4673-9a3f-33dde9b5b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converting VIF {"id": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "address": "fa:16:3e:32:db:e6", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1bd3dc6-76", "ovs_interfaceid": "d1bd3dc6-765e-404a-bbbc-41b704a03e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG os_vif [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1bd3dc6-76, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1deb479b-0cb1-4f7b-b4d4-6ae22cf585fe) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:03 user nova-compute[74820]: INFO os_vif [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:db:e6,bridge_name='br-int',has_traffic_filtering=True,id=d1bd3dc6-765e-404a-bbbc-41b704a03e77,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1bd3dc6-76')
Nov 08 18:37:03 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Deleting instance files /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e_del
Nov 08 18:37:03 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Deletion of /opt/stack/data/nova/instances/fb521d9b-a6c2-4673-9a3f-33dde9b5b79e_del complete
Nov 08 18:37:04 user nova-compute[74820]: INFO nova.compute.manager [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:04 user nova-compute[74820]: INFO nova.compute.manager [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Terminating instance
Nov 08 18:37:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:04 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Took 0.60 seconds to deallocate network for instance.
Nov 08 18:37:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-081ef299-639c-41bd-ad13-64283c2c0376 req-2df8eb5e-bd57-4dc4-b321-e43e4c91ab14 service nova] [instance: fb521d9b-a6c2-4673-9a3f-33dde9b5b79e] Received event network-vif-deleted-d1bd3dc6-765e-404a-bbbc-41b704a03e77 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:04 user nova-compute[74820]: INFO nova.compute.manager [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Terminating instance
Nov 08 18:37:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Instance destroyed successfully.
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'resources' on Instance uuid 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:30:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-674409609',display_name='tempest-ServerActionsTestOtherA-server-2011474520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-674409609',id=14,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOyJSZaNwBdRj1hWE7uv2aBJY3g3C1v/eMFBUqPoGZMPW+a7ET03xsrCvH7D3VLG92nqRTg+wE3xk+rVA03MMCw0PZt/WhLbrYFQrzWlgDZ9P1DrK6EcLhnLTDNNa1HQA==',key_name='tempest-keypair-1672348396',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-8rmn5v7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=42d369f9-f38b-4ddf-acb7-72f3f54f7f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "address": "fa:16:3e:92:ce:7a", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4564ddbd-d3", "ovs_interfaceid": "4564ddbd-d3fa-45cc-81a3-76e687daf8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_vif [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4564ddbd-d3, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9001adea-8dea-4e75-9fbe-4b28a2d54f1d) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: INFO os_vif [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:ce:7a,bridge_name='br-int',has_traffic_filtering=True,id=4564ddbd-d3fa-45cc-81a3-76e687daf8b6,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4564ddbd-d3')
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Deleting instance files /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f_del
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Deletion of /opt/stack/data/nova/instances/42d369f9-f38b-4ddf-acb7-72f3f54f7f8f_del complete
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'flavor' on Instance uuid d4bbc087-e9df-431d-9c42-9e10718e7e6d {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-89dd40d2-7f57-4862-b72d-be521262814e req-7f9eac01-d408-4a75-8808-89b0d341dbdd service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-unplugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-89dd40d2-7f57-4862-b72d-be521262814e req-7f9eac01-d408-4a75-8808-89b0d341dbdd service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-89dd40d2-7f57-4862-b72d-be521262814e req-7f9eac01-d408-4a75-8808-89b0d341dbdd service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-89dd40d2-7f57-4862-b72d-be521262814e req-7f9eac01-d408-4a75-8808-89b0d341dbdd service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-89dd40d2-7f57-4862-b72d-be521262814e req-7f9eac01-d408-4a75-8808-89b0d341dbdd service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-unplugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-89dd40d2-7f57-4862-b72d-be521262814e req-7f9eac01-d408-4a75-8808-89b0d341dbdd service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-unplugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Deleted allocations for instance fb521d9b-a6c2-4673-9a3f-33dde9b5b79e
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.183s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.compute.manager [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d29631f-86b0-4885-a8cd-4206aca8f227 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "fb521d9b-a6c2-4673-9a3f-33dde9b5b79e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.compute.manager [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Attaching volume 66eb7ac6-848d-4550-bb18-fb1104cec091 to /dev/vdb
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.utils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[84372a04-9b24-4a10-ad3e-eaeddc940b0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Instance destroyed successfully.
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.objects.instance [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lazy-loading 'resources' on Instance uuid a19102f1-af5a-4cb1-876f-8d053abed70b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36eb0df-8584-4da8-8201-b4e20cc480a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276469762',display_name='tempest-ServerActionsTestOtherB-server-276469762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276469762',id=5,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRsBTsAsHGV1dRnTpC6HA+AOj+OCS+uv7LJ5Uqr9WLqeAZl5MWV26zGdg795URqVx87XjY5pFlYQGKM1EGt7Nfpp9TujgEyF6x5qgb45TF4kQkqkkbPhjlZClOlrK/xvw==',key_name='tempest-keypair-1674909203',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:34:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e230a1c67e924522b88cfc57decccb17',ramdisk_id='',reservation_id='r-kenb50ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-740424869',owner_user_name='tempest-ServerActionsTestOtherB-740424869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:34:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d7a66f28dd1417980df3a2f3a64bc0e',uuid=a19102f1-af5a-4cb1-876f-8d053abed70b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converting VIF {"id": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "address": "fa:16:3e:33:c7:d1", "network": {"id": "f89dd2e4-3e84-4abc-9e91-dd17226d76e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1489345576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e230a1c67e924522b88cfc57decccb17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85125f2a-e0", "ovs_interfaceid": "85125f2a-e0c8-4893-8e27-7036ee1bb847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_vif [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85125f2a-e0, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dde83b-6b3d-446a-a8d3-9656fe70dd05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0600228a-7b28-4d2c-8c25-6f9892ee24ca) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[163672bc-c98c-453f-892a-0e0a328bb2a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: INFO os_vif [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c7:d1,bridge_name='br-int',has_traffic_filtering=True,id=85125f2a-e0c8-4893-8e27-7036ee1bb847,network=Network(f89dd2e4-3e84-4abc-9e91-dd17226d76e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85125f2a-e0')
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ArcIaCeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:37:05 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:37:05 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dfb8e7-5c6f-479e-a78c-f4b8ad8d0e5f]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.utils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updating existing volume attachment record: 4b207911-07ce-4b57-981d-9d6c6ae687a9 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c40458-4149-4de5-aa57-b4a8bd993444]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:37:05 user nova-compute[74820]: No targets found.
Nov 08 18:37:05 user nova-compute[74820]: iSNS:
Nov 08 18:37:05 user nova-compute[74820]: No targets found.
Nov 08 18:37:05 user nova-compute[74820]: STATIC:
Nov 08 18:37:05 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:37:05 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:05 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:05 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c
Nov 08 18:37:05 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:05 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:05 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1
Nov 08 18:37:05 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:05 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:05 user nova-compute[74820]: FIRMWARE:
Nov 08 18:37:05 user nova-compute[74820]: No targets found.
Nov 08 18:37:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:37:05 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:37:05 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218f5a7-b452-4069-b6be-0c39f036e11b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9c5fb3-25d9-4ef8-af67-85f04bb7725c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:37:05 user nova-compute[74820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:05 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c (non-flash)
Nov 08 18:37:05 user nova-compute[74820]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:05 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2812e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46accef-1914-4d9d-8540-dea7efe9aa6c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e5340-63b7-42b3-9500-cd244f8a2000]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf965d6-697c-4701-a78d-3a5f756a2cb5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e86b5-c684-48f5-a585-47ea113f9bd1]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9599d0-9ed9-4af6-9186-2390ebcf87fd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf55d43-afaa-4adc-9bd7-6ff7f07506ff]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260]
Nov 08 18:37:06 user nova-compute[74820]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c, portal: 172.16.0.220,3260] successful.
Nov 08 18:37:06 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6acc4c8-12f7-4fc5-a6bc-a86d5d3d7c6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4bde19-7f31-4a7c-8782-eb90f0e372fa]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] <== disconnect_volume: return (358ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:37:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Deleting instance files /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b_del
Nov 08 18:37:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Deletion of /opt/stack/data/nova/instances/a19102f1-af5a-4cb1-876f-8d053abed70b_del complete
Nov 08 18:37:06 user nova-compute[74820]: INFO nova.compute.manager [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:06 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Took 1.13 seconds to deallocate network for instance.
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-unplugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] Acquiring lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] No waiting events found dispatching network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:06 user nova-compute[74820]: WARNING nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received unexpected event network-vif-plugged-85125f2a-e0c8-4893-8e27-7036ee1bb847 for instance with vm_state active and task_state deleting.
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-a322f38d-6b5a-4075-8090-0dbdf467db31 req-cf57a6f7-942b-4276-8191-bc4b0120b617 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-deleted-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:06 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Deleted allocations for instance 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f
Nov 08 18:37:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e34e2be8-c4fd-41ea-b308-b0be8e5a110c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.763s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:07 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:07 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Took 1.11 seconds to deallocate network for instance.
Nov 08 18:37:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-f4c47b06-bacb-4973-8fc1-ebac30b5af2b req-921d35cd-1d8d-4fc2-926b-b9526d504bf3 service nova] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Received event network-vif-deleted-85125f2a-e0c8-4893-8e27-7036ee1bb847 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-2311aec8-472c-44f6-b4c4-f306377a1198 req-711f41ed-6a7c-439a-8269-ad9ee8123703 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2311aec8-472c-44f6-b4c4-f306377a1198 req-711f41ed-6a7c-439a-8269-ad9ee8123703 service nova] Acquiring lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2311aec8-472c-44f6-b4c4-f306377a1198 req-711f41ed-6a7c-439a-8269-ad9ee8123703 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2311aec8-472c-44f6-b4c4-f306377a1198 req-711f41ed-6a7c-439a-8269-ad9ee8123703 service nova] Lock "42d369f9-f38b-4ddf-acb7-72f3f54f7f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-2311aec8-472c-44f6-b4c4-f306377a1198 req-711f41ed-6a7c-439a-8269-ad9ee8123703 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] No waiting events found dispatching network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:07 user nova-compute[74820]: WARNING nova.compute.manager [req-2311aec8-472c-44f6-b4c4-f306377a1198 req-711f41ed-6a7c-439a-8269-ad9ee8123703 service nova] [instance: 42d369f9-f38b-4ddf-acb7-72f3f54f7f8f] Received unexpected event network-vif-plugged-4564ddbd-d3fa-45cc-81a3-76e687daf8b6 for instance with vm_state deleted and task_state None.
Nov 08 18:37:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Acquiring lock "5990e789-29d0-40cc-85ed-e7e707c922dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Lock "5990e789-29d0-40cc-85ed-e7e707c922dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:37:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:20 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:37:20 user nova-compute[74820]: INFO nova.compute.claims [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Claim successful on node user
Nov 08 18:37:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:37:21 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.policy [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d58e768fac2456eaefc3680f9bc0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d5f571ed94b3392cd2ab1fb12170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:37:21 user nova-compute[74820]: INFO nova.virt.block_device [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Booting with volume 03071a3d-461e-4520-a400-1e06dd2adae1 at /dev/vda
Nov 08 18:37:21 user nova-compute[74820]: DEBUG os_brick.utils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8111a0cf-0098-4873-b58d-4bb1d0f6b207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8a6fa-0029-4d5b-87bc-419c784e8092]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe38c14f-8e91-4684-83cb-edfb33c91e87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530477b-7af8-4381-9d4c-d009a20d2497]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:37:21 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:37:21 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852dac9-fdf2-4cc9-a8a7-2665649fcc93]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG os_brick.utils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:37:21 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Updating existing volume attachment record: c39f500a-99a7-41d3-9366-9b7a7e86749c {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Successfully created port: d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Successfully updated port: d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Acquiring lock "refresh_cache-5990e789-29d0-40cc-85ed-e7e707c922dd" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Acquired lock "refresh_cache-5990e789-29d0-40cc-85ed-e7e707c922dd" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Received event network-changed-d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Refreshing instance network info cache due to event network-changed-d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] Acquiring lock "refresh_cache-5990e789-29d0-40cc-85ed-e7e707c922dd" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:37:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Updating instance_info_cache with network_info: [{"id": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "address": "fa:16:3e:85:c3:4f", "network": {"id": "e56db77a-58d0-4284-8d65-ed3c34e432b3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1339714837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6d5f571ed94b3392cd2ab1fb12170b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7dacdd5-23", "ovs_interfaceid": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Releasing lock "refresh_cache-5990e789-29d0-40cc-85ed-e7e707c922dd" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Instance network_info: |[{"id": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "address": "fa:16:3e:85:c3:4f", "network": {"id": "e56db77a-58d0-4284-8d65-ed3c34e432b3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1339714837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6d5f571ed94b3392cd2ab1fb12170b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7dacdd5-23", "ovs_interfaceid": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] Acquired lock "refresh_cache-5990e789-29d0-40cc-85ed-e7e707c922dd" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Refreshing network info cache for port d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Updated VIF entry in instance network info cache for port d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Updating instance_info_cache with network_info: [{"id": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "address": "fa:16:3e:85:c3:4f", "network": {"id": "e56db77a-58d0-4284-8d65-ed3c34e432b3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1339714837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6d5f571ed94b3392cd2ab1fb12170b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7dacdd5-23", "ovs_interfaceid": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-710b7e8b-8be3-4509-9947-30f1cf7b6768 req-c277fb2e-b1cb-4a80-bfa0-fb9de696f307 service nova] Releasing lock "refresh_cache-5990e789-29d0-40cc-85ed-e7e707c922dd" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:37:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:30 user nova-compute[74820]: INFO nova.compute.manager [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] [instance: a19102f1-af5a-4cb1-876f-8d053abed70b] Took 22.84 seconds to detach 1 volumes for instance.
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.volume.cinder [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Update attachment failed for attachment c39f500a-99a7-41d3-9366-9b7a7e86749c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac)
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Traceback (most recent call last):
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     driver_block_device.attach_block_devices(
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     _log_and_attach(device)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     self._do_attach(context, instance, volume, volume_api,
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     self._volume_attach(context, volume, connector, instance,
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     connection_info = volume_api.attachment_update(
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     res = method(self, ctx, *args, **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     with excutils.save_and_reraise_exception():
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     self.force_reraise()
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     raise self.value
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     return method.func(obj, *args, **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     resp = self._update('/attachments/%s' % id, body)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     return self.request(url, method, **kwargs)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd]     raise exceptions.from_response(resp, body)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac)
Nov 08 18:37:30 user nova-compute[74820]: ERROR nova.compute.manager [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] 
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.compute.claims [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Aborting claim: <nova.compute.claims.Claim object at 0x7f3e28645e10> {{(pid=74820) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyedzHxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:37:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:37:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:37:30 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.024s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd551fd-e485-4034-803e-3cd662d1e06e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:37:30 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Deleted allocations for instance a19102f1-af5a-4cb1-876f-8d053abed70b
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[136250be-d079-4735-aa23-2695d1b0b7e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091] added
Nov 08 18:37:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2fb697-1949-4539-b819-e226760bca3c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b02b0-c34f-4359-8d58-4f4d049e4f72]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyedzHxZ {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyedzHxZ" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[616463b3-e899-47f3-98f1-ffaa32cf2cf8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OyedzHxZ'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-00c06497-4841-4119-90b5-6e6d6bbc3064 tempest-ServerActionsTestOtherB-740424869 tempest-ServerActionsTestOtherB-740424869-project-member] Lock "a19102f1-af5a-4cb1-876f-8d053abed70b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 25.889s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ed8b7-b91a-4926-b5ad-0ccd93015cd2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b8480a-5bdd-43c3-8cb1-258a9e05a95b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a8f5e9-7c63-48da-84ed-247fa2dc2259]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260]
Nov 08 18:37:30 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260] successful.
Nov 08 18:37:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5429b0-630b-4d11-8f97-3e805bf6d96b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9694c6c-6777-4465-9222-3d5b5f37e514]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:30 user nova-compute[74820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)
Nov 08 18:37:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:30 user nova-compute[74820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)
Nov 08 18:37:30 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ef9d7-4435-4bbe-bb39-878b839c8571]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.418s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Build of instance 5990e789-29d0-40cc-85ed-e7e707c922dd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac) {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.compute.utils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Build of instance 5990e789-29d0-40cc-85ed-e7e707c922dd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74820) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 18:37:31 user nova-compute[74820]: ERROR nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Build of instance 5990e789-29d0-40cc-85ed-e7e707c922dd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac): nova.exception.BuildAbortException: Build of instance 5990e789-29d0-40cc-85ed-e7e707c922dd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac)
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Unplugging VIFs for instance {{(pid=74820) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1225708324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1225708324',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCInvAGIM9PILPsEIrS5MWDHOmBlzntmiAlq02jQm3z1OcBq7RLgol7H8I4AEKKpaoId9Kxl0nYVTfponFNABZBfpt0URIYoXbSj/mamRfg7cSMnmxvsd2iAMzgiiHdxow==',key_name='tempest-keypair-1633780800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e6d5f571ed94b3392cd2ab1fb12170b',ramdisk_id='',reservation_id='r-cagpfk5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-255088095',owner_user_name='tempest-ServerActionsV293TestJSON-255088095-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d58e768fac2456eaefc3680f9bc0de0',uuid=5990e789-29d0-40cc-85ed-e7e707c922dd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "address": "fa:16:3e:85:c3:4f", "network": {"id": "e56db77a-58d0-4284-8d65-ed3c34e432b3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1339714837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6d5f571ed94b3392cd2ab1fb12170b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7dacdd5-23", "ovs_interfaceid": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Converting VIF {"id": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "address": "fa:16:3e:85:c3:4f", "network": {"id": "e56db77a-58d0-4284-8d65-ed3c34e432b3", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1339714837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e6d5f571ed94b3392cd2ab1fb12170b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7dacdd5-23", "ovs_interfaceid": "d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:c3:4f,bridge_name='br-int',has_traffic_filtering=True,id=d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4,network=Network(e56db77a-58d0-4284-8d65-ed3c34e432b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7dacdd5-23') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG os_vif [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:c3:4f,bridge_name='br-int',has_traffic_filtering=True,id=d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4,network=Network(e56db77a-58d0-4284-8d65-ed3c34e432b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7dacdd5-23') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7dacdd5-23, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:37:31 user nova-compute[74820]: INFO os_vif [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:c3:4f,bridge_name='br-int',has_traffic_filtering=True,id=d7dacdd5-236e-4d4c-bf09-aa53cf7cb8a4,network=Network(e56db77a-58d0-4284-8d65-ed3c34e432b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7dacdd5-23')
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Unplugged VIFs for instance {{(pid=74820) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:31 user nova-compute[74820]: INFO nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Took 0.51 seconds to deallocate network for instance.
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Detaching volume: 03071a3d-461e-4520-a400-1e06dd2adae1 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 18:37:31 user nova-compute[74820]: INFO nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Detaching volume 03071a3d-461e-4520-a400-1e06dd2adae1
Nov 08 18:37:31 user nova-compute[74820]: ERROR nova.virt.block_device [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Unable to call for a driver detach of volume 03071a3d-461e-4520-a400-1e06dd2adae1 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 5990e789-29d0-40cc-85ed-e7e707c922dd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6be39f8f-17b1-44b9-87a7-24fa6b5607ac)
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] [instance: 5990e789-29d0-40cc-85ed-e7e707c922dd] Deleting volume: 03071a3d-461e-4520-a400-1e06dd2adae1 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyedzHxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26631613464373634', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613464373634', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'flavor' on Instance uuid d4bbc087-e9df-431d-9c42-9e10718e7e6d {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:31 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Deleted allocations for instance 5990e789-29d0-40cc-85ed-e7e707c922dd
Nov 08 18:37:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0ee48a79-26b4-4648-aad4-0142ea2c13d0 tempest-ServerActionsV293TestJSON-255088095 tempest-ServerActionsV293TestJSON-255088095-project-member] Lock "5990e789-29d0-40cc-85ed-e7e707c922dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.438s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:37:31 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:37:31 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:37:31 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:37:31 user nova-compute[74820]:   <serial>66eb7ac6-848d-4550-bb18-fb1104cec091</serial>
Nov 08 18:37:31 user nova-compute[74820]: </disk>
Nov 08 18:37:31 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:37:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:37:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:37:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No VIF found with MAC fa:16:3e:bc:22:aa, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:37:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0707fc69-713b-4a55-ad08-f5f91b60af4c tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.989s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:34 user nova-compute[74820]: INFO nova.compute.manager [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Detaching volume 66eb7ac6-848d-4550-bb18-fb1104cec091
Nov 08 18:37:34 user nova-compute[74820]: INFO nova.virt.block_device [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Attempting to driver detach volume 66eb7ac6-848d-4550-bb18-fb1104cec091 from mountpoint /dev/vdb
Nov 08 18:37:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Attempting to detach device vdb from instance d4bbc087-e9df-431d-9c42-9e10718e7e6d from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:37:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:37:34 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:37:34 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:37:34 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:37:34 user nova-compute[74820]:   <serial>66eb7ac6-848d-4550-bb18-fb1104cec091</serial>
Nov 08 18:37:34 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:37:34 user nova-compute[74820]: </disk>
Nov 08 18:37:34 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:37:34 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Successfully detached device vdb from instance d4bbc087-e9df-431d-9c42-9e10718e7e6d from the persistent domain config.
Nov 08 18:37:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4bbc087-e9df-431d-9c42-9e10718e7e6d from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:37:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:37:34 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:37:34 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:37:34 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:37:34 user nova-compute[74820]:   <serial>66eb7ac6-848d-4550-bb18-fb1104cec091</serial>
Nov 08 18:37:34 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:37:34 user nova-compute[74820]: </disk>
Nov 08 18:37:34 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:37:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4bbc087-e9df-431d-9c42-9e10718e7e6d {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:37:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:39 user nova-compute[74820]: INFO nova.compute.manager [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Terminating instance
Nov 08 18:37:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-06c8ec02-fc86-422c-a361-fb98be9c6c3c req-7afe9cb7-222f-48a2-aff5-fd71664d5e47 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-vif-unplugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-06c8ec02-fc86-422c-a361-fb98be9c6c3c req-7afe9cb7-222f-48a2-aff5-fd71664d5e47 service nova] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-06c8ec02-fc86-422c-a361-fb98be9c6c3c req-7afe9cb7-222f-48a2-aff5-fd71664d5e47 service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-06c8ec02-fc86-422c-a361-fb98be9c6c3c req-7afe9cb7-222f-48a2-aff5-fd71664d5e47 service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-06c8ec02-fc86-422c-a361-fb98be9c6c3c req-7afe9cb7-222f-48a2-aff5-fd71664d5e47 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] No waiting events found dispatching network-vif-unplugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-06c8ec02-fc86-422c-a361-fb98be9c6c3c req-7afe9cb7-222f-48a2-aff5-fd71664d5e47 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-vif-unplugged-75f8c392-b792-41f4-8980-6dee8f615458 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:37:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Instance destroyed successfully.
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'resources' on Instance uuid e6c0f58b-f65e-48bf-811b-ac3c1bc6456e {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1362727159',display_name='tempest-TestVolumeBootPattern-server-1362727159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1362727159',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:36:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-u10qtrcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:36:32Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=e6c0f58b-f65e-48bf-811b-ac3c1bc6456e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "75f8c392-b792-41f4-8980-6dee8f615458", "address": "fa:16:3e:5a:e2:d0", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f8c392-b7", "ovs_interfaceid": "75f8c392-b792-41f4-8980-6dee8f615458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_vif [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75f8c392-b7, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a4aa083-6c88-437a-a7f9-823d9e6a9651) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:40 user nova-compute[74820]: INFO os_vif [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e2:d0,bridge_name='br-int',has_traffic_filtering=True,id=75f8c392-b792-41f4-8980-6dee8f615458,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f8c392-b7')
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FopDqTEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:37:40 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd090855-9f22-40b0-af45-abcc28fcf673]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:37:40 user nova-compute[74820]: No targets found.
Nov 08 18:37:40 user nova-compute[74820]: iSNS:
Nov 08 18:37:40 user nova-compute[74820]: No targets found.
Nov 08 18:37:40 user nova-compute[74820]: STATIC:
Nov 08 18:37:40 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091
Nov 08 18:37:40 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:40 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:40 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:37:40 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:40 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:40 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1
Nov 08 18:37:40 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:40 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:40 user nova-compute[74820]: FIRMWARE:
Nov 08 18:37:40 user nova-compute[74820]: No targets found.
Nov 08 18:37:40 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:37:40 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:37:40 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60482191-7011-4b71-9041-580ba3131070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a41b46-5663-4873-b9b6-810dcd9ea8e3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:40 user nova-compute[74820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)
Nov 08 18:37:40 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:40 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 (non-flash)
Nov 08 18:37:40 user nova-compute[74820]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)
Nov 08 18:37:40 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:40 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e40381bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3266f774-2f81-47b0-8c30-2ea27c79935e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd16b9e6-2029-44d5-b04f-0dfd8a392cc4]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59912251-9171-4f6b-a114-f61b5963d8b7]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a881bbc-887b-4b89-915f-3644e4b011e4]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26136393032323338', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_25efa54f', '/dev/disk/by-id/scsi-1SCST_BIO25efa54f-a69022383ed9e65e') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3deb2d7-e4aa-4e6b-be30-70c78d10b338]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b182df4-3035-46c5-b2ee-86238e9c3f22]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb7abe-8c90-43a6-a252-bb24cb08d071]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260]
Nov 08 18:37:40 user nova-compute[74820]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1, portal: 172.16.0.220,3260] successful.
Nov 08 18:37:40 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49fd4908-00de-4112-9eb0-1ff114e94ce1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0aaf39-d66c-4a50-8084-0198f513efad]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== disconnect_volume: return (320ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:37:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Deleting instance files /opt/stack/data/nova/instances/e6c0f58b-f65e-48bf-811b-ac3c1bc6456e_del
Nov 08 18:37:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Deletion of /opt/stack/data/nova/instances/e6c0f58b-f65e-48bf-811b-ac3c1bc6456e_del complete
Nov 08 18:37:40 user nova-compute[74820]: INFO nova.compute.manager [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 08 18:37:40 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:37:40 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:37:41 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:41 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Took 0.49 seconds to deallocate network for instance.
Nov 08 18:37:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] Acquiring lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] No waiting events found dispatching network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:41 user nova-compute[74820]: WARNING nova.compute.manager [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received unexpected event network-vif-plugged-75f8c392-b792-41f4-8980-6dee8f615458 for instance with vm_state active and task_state deleting.
Nov 08 18:37:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-99cb4d18-15f5-4c8e-82c3-ce1d7d3b765b req-2a8bfcdc-a19b-48c0-ba63-7cc4b61d0878 service nova] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Received event network-vif-deleted-75f8c392-b792-41f4-8980-6dee8f615458 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:42 user nova-compute[74820]: INFO nova.compute.manager [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Took 0.97 seconds to detach 1 volumes for instance.
Nov 08 18:37:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: e6c0f58b-f65e-48bf-811b-ac3c1bc6456e] Deleting volume: 49fd4908-00de-4112-9eb0-1ff114e94ce1 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 18:37:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:42 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:42 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:42 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Deleted allocations for instance e6c0f58b-f65e-48bf-811b-ac3c1bc6456e
Nov 08 18:37:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f02a16fd-f4a0-4ef8-971c-0964d9856cbc tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "e6c0f58b-f65e-48bf-811b-ac3c1bc6456e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.362s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:37:49 user nova-compute[74820]: INFO nova.compute.claims [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Claim successful on node user
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.network.neutron [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:37:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.policy [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23005c9177444a5da028f8f60202e1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f1ade1323846c39c48886010ea85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:37:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Creating image(s)
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "/opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "/opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "/opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.228s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk 1073741824" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG nova.network.neutron [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Successfully created port: b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Cannot resize image /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Ensure instance console log exists: /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Successfully updated port: b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquired lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-changed-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Refreshing instance network info cache due to event network-changed-b4db4a79-3abf-4e9a-808e-9d7a1e43c754. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] Acquiring lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updating instance_info_cache with network_info: [{"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Releasing lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Instance network_info: |[{"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] Acquired lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.neutron [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Refreshing network info cache for port b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Start _get_guest_xml network_info=[{"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:37:51 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:37:51 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-248739429',display_name='tempest-VolumesSnapshotTestJSON-instance-248739429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-248739429',id=25,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAh/jMHbMQs3yd64Qrb6xTk2MhEYtx8LnDh7S9HbYk04yhEw2wV6KPOEoTederkqHsKboM/pW+wmDGFoc/SHZNUya6u2o7BWiNjlFkUGUhx028de2keafEfaX6H6rNWkA==',key_name='tempest-keypair-403931339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f1ade1323846c39c48886010ea85e9',ramdisk_id='',reservation_id='r-s0fwfsmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1628967070',owner_user_name='tempest-VolumesSnapshotTestJSON-1628967070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23005c9177444a5da028f8f60202e1fc',uuid=94ab5fd7-d916-440a-8cfb-6a7572c242e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converting VIF {"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.objects.instance [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'pci_devices' on Instance uuid 94ab5fd7-d916-440a-8cfb-6a7572c242e3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:37:51 user nova-compute[74820]:   <uuid>94ab5fd7-d916-440a-8cfb-6a7572c242e3</uuid>
Nov 08 18:37:51 user nova-compute[74820]:   <name>instance-00000019</name>
Nov 08 18:37:51 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:37:51 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:37:51 user nova-compute[74820]:   <metadata>
Nov 08 18:37:51 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:37:51 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:37:51 user nova-compute[74820]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-248739429</nova:name>
Nov 08 18:37:51 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:37:51</nova:creationTime>
Nov 08 18:37:51 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:37:51 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:37:51 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:37:51 user nova-compute[74820]:       <nova:owner>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:user uuid="23005c9177444a5da028f8f60202e1fc">tempest-VolumesSnapshotTestJSON-1628967070-project-member</nova:user>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:project uuid="53f1ade1323846c39c48886010ea85e9">tempest-VolumesSnapshotTestJSON-1628967070</nova:project>
Nov 08 18:37:51 user nova-compute[74820]:       </nova:owner>
Nov 08 18:37:51 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:37:51 user nova-compute[74820]:       <nova:ports>
Nov 08 18:37:51 user nova-compute[74820]:         <nova:port uuid="b4db4a79-3abf-4e9a-808e-9d7a1e43c754">
Nov 08 18:37:51 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:37:51 user nova-compute[74820]:         </nova:port>
Nov 08 18:37:51 user nova-compute[74820]:       </nova:ports>
Nov 08 18:37:51 user nova-compute[74820]:     </nova:instance>
Nov 08 18:37:51 user nova-compute[74820]:   </metadata>
Nov 08 18:37:51 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:37:51 user nova-compute[74820]:     <system>
Nov 08 18:37:51 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:37:51 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:37:51 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:37:51 user nova-compute[74820]:       <entry name="serial">94ab5fd7-d916-440a-8cfb-6a7572c242e3</entry>
Nov 08 18:37:51 user nova-compute[74820]:       <entry name="uuid">94ab5fd7-d916-440a-8cfb-6a7572c242e3</entry>
Nov 08 18:37:51 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:37:51 user nova-compute[74820]:     </system>
Nov 08 18:37:51 user nova-compute[74820]:   </sysinfo>
Nov 08 18:37:51 user nova-compute[74820]:   <os>
Nov 08 18:37:51 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:37:51 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:37:51 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:37:51 user nova-compute[74820]:   </os>
Nov 08 18:37:51 user nova-compute[74820]:   <features>
Nov 08 18:37:51 user nova-compute[74820]:     <acpi/>
Nov 08 18:37:51 user nova-compute[74820]:     <apic/>
Nov 08 18:37:51 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:37:51 user nova-compute[74820]:   </features>
Nov 08 18:37:51 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:37:51 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:37:51 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:37:51 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:37:51 user nova-compute[74820]:   </clock>
Nov 08 18:37:51 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:37:51 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:37:51 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:37:51 user nova-compute[74820]:   </cpu>
Nov 08 18:37:51 user nova-compute[74820]:   <devices>
Nov 08 18:37:51 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:37:51 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:37:51 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk"/>
Nov 08 18:37:51 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:37:51 user nova-compute[74820]:     </disk>
Nov 08 18:37:51 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:37:51 user nova-compute[74820]:       <mac address="fa:16:3e:3a:64:3d"/>
Nov 08 18:37:51 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:37:51 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:37:51 user nova-compute[74820]:       <target dev="tapb4db4a79-3a"/>
Nov 08 18:37:51 user nova-compute[74820]:     </interface>
Nov 08 18:37:51 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:37:51 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/console.log" append="off"/>
Nov 08 18:37:51 user nova-compute[74820]:     </serial>
Nov 08 18:37:51 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:37:51 user nova-compute[74820]:     <video>
Nov 08 18:37:51 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:37:51 user nova-compute[74820]:     </video>
Nov 08 18:37:51 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:37:51 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:37:51 user nova-compute[74820]:     </rng>
Nov 08 18:37:51 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:37:51 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:37:51 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:37:51 user nova-compute[74820]:     </memballoon>
Nov 08 18:37:51 user nova-compute[74820]:   </devices>
Nov 08 18:37:51 user nova-compute[74820]: </domain>
Nov 08 18:37:51 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-248739429',display_name='tempest-VolumesSnapshotTestJSON-instance-248739429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-248739429',id=25,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAh/jMHbMQs3yd64Qrb6xTk2MhEYtx8LnDh7S9HbYk04yhEw2wV6KPOEoTederkqHsKboM/pW+wmDGFoc/SHZNUya6u2o7BWiNjlFkUGUhx028de2keafEfaX6H6rNWkA==',key_name='tempest-keypair-403931339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53f1ade1323846c39c48886010ea85e9',ramdisk_id='',reservation_id='r-s0fwfsmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1628967070',owner_user_name='tempest-VolumesSnapshotTestJSON-1628967070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:37:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23005c9177444a5da028f8f60202e1fc',uuid=94ab5fd7-d916-440a-8cfb-6a7572c242e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converting VIF {"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG os_vif [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faa198e6-c9e2-59a9-bb04-eb9fcca1fe4f', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4db4a79-3a, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4db4a79-3a, col_values=(('qos', UUID('be11cb8e-34c1-4919-9c79-ba807d943e34')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4db4a79-3a, col_values=(('external_ids', {'iface-id': 'b4db4a79-3abf-4e9a-808e-9d7a1e43c754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:64:3d', 'vm-uuid': '94ab5fd7-d916-440a-8cfb-6a7572c242e3'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:51 user nova-compute[74820]: INFO os_vif [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a')
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:37:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No VIF found with MAC fa:16:3e:3a:64:3d, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG nova.network.neutron [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updated VIF entry in instance network info cache for port b4db4a79-3abf-4e9a-808e-9d7a1e43c754. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG nova.network.neutron [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updating instance_info_cache with network_info: [{"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9f2b550b-8e5b-4756-8f78-160a33f82bbf req-186b4534-dd12-4be8-a077-08df5e1ecc7c service nova] Releasing lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:37:52 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:37:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=25.26184844970703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 490de0ea-289a-45aa-bb05-14fb138fb833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d4bbc087-e9df-431d-9c42-9e10718e7e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-e1ecc01f-d660-4fe6-888c-07317da740c5 req-6be07b6b-53db-4f21-9cd6-727ff4588493 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e1ecc01f-d660-4fe6-888c-07317da740c5 req-6be07b6b-53db-4f21-9cd6-727ff4588493 service nova] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e1ecc01f-d660-4fe6-888c-07317da740c5 req-6be07b6b-53db-4f21-9cd6-727ff4588493 service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e1ecc01f-d660-4fe6-888c-07317da740c5 req-6be07b6b-53db-4f21-9cd6-727ff4588493 service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-e1ecc01f-d660-4fe6-888c-07317da740c5 req-6be07b6b-53db-4f21-9cd6-727ff4588493 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] No waiting events found dispatching network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:53 user nova-compute[74820]: WARNING nova.compute.manager [req-e1ecc01f-d660-4fe6-888c-07317da740c5 req-6be07b6b-53db-4f21-9cd6-727ff4588493 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received unexpected event network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 for instance with vm_state building and task_state spawning.
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:54 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4bbc087-e9df-431d-9c42-9e10718e7e6d is timed out.
Nov 08 18:37:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Successfully detached device vdb from instance d4bbc087-e9df-431d-9c42-9e10718e7e6d from the live domain config.
Nov 08 18:37:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyedzHxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:37:54 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a49e76-da9b-46ea-8f6e-5e64bef5f42d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:37:54 user nova-compute[74820]: No targets found.
Nov 08 18:37:54 user nova-compute[74820]: iSNS:
Nov 08 18:37:54 user nova-compute[74820]: No targets found.
Nov 08 18:37:54 user nova-compute[74820]: STATIC:
Nov 08 18:37:54 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091
Nov 08 18:37:54 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:54 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:54 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:37:54 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:37:54 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:37:54 user nova-compute[74820]: FIRMWARE:
Nov 08 18:37:54 user nova-compute[74820]: No targets found.
Nov 08 18:37:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:37:54 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:37:54 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[71449367-2cc1-4ce4-9f85-f9f038951bd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5413bc-f826-40cd-abb2-eccf097ce47e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)
Nov 08 18:37:54 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 (non-flash)
Nov 08 18:37:54 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:37:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28243d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7720afb-2865-45a2-afb4-69f54f7a9cbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c883a023-2dee-444b-bdcc-352290029de5]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a855bbda-15a7-49cf-8cf8-ecc3cc036774]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b7a32c-3fdd-415e-80ce-f055f0aa5f40]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268597a-e247-430b-b30c-bb4b6ea37b1f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70207f62-22ad-4e8b-864f-9c8be42d5b68]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260]
Nov 08 18:37:54 user nova-compute[74820]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091, portal: 172.16.0.220,3260] successful.
Nov 08 18:37:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eb7ac6-848d-4550-bb18-fb1104cec091 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6be89f-a22f-4681-98ac-20a6adfa7aa5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] <== disconnect_volume: return (362ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec8b93f5-d646-4cfd-b4ef-730f289959cc req-ad82a356-36c9-4173-942a-141a46bef04a service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec8b93f5-d646-4cfd-b4ef-730f289959cc req-ad82a356-36c9-4173-942a-141a46bef04a service nova] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec8b93f5-d646-4cfd-b4ef-730f289959cc req-ad82a356-36c9-4173-942a-141a46bef04a service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec8b93f5-d646-4cfd-b4ef-730f289959cc req-ad82a356-36c9-4173-942a-141a46bef04a service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec8b93f5-d646-4cfd-b4ef-730f289959cc req-ad82a356-36c9-4173-942a-141a46bef04a service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] No waiting events found dispatching network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:37:55 user nova-compute[74820]: WARNING nova.compute.manager [req-ec8b93f5-d646-4cfd-b4ef-730f289959cc req-ad82a356-36c9-4173-942a-141a46bef04a service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received unexpected event network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 for instance with vm_state building and task_state spawning.
Nov 08 18:37:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:37:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Instance spawned successfully.
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:37:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: c51df6e9-c969-4869-88be-77c877029dde] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:37:56 user nova-compute[74820]: INFO nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 08 18:37:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:37:56 user nova-compute[74820]: INFO nova.compute.manager [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Took 7.06 seconds to build instance.
Nov 08 18:37:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-668b3827-1b24-4159-b349-c20ab3abc1ba tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.172s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'flavor' on Instance uuid d4bbc087-e9df-431d-9c42-9e10718e7e6d {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f27db206-3d57-4166-a45b-40139d6058fe tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.288s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:37:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:37:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:38:01 user nova-compute[74820]: INFO nova.compute.manager [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] instance snapshotting
Nov 08 18:38:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:01 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Beginning live snapshot process
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.166s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplerj88wl/959fafeba99343a8a8e1152c2da0dbba.delta 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplerj88wl/959fafeba99343a8a8e1152c2da0dbba.delta 1073741824" returned: 0 in 0.059s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 18:38:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:38:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] COPY block job progress, current cursor: 21495808 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:38:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:38:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 18:38:04 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:38:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplerj88wl/959fafeba99343a8a8e1152c2da0dbba.delta /opt/stack/data/nova/instances/snapshots/tmplerj88wl/959fafeba99343a8a8e1152c2da0dbba {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplerj88wl/959fafeba99343a8a8e1152c2da0dbba.delta /opt/stack/data/nova/instances/snapshots/tmplerj88wl/959fafeba99343a8a8e1152c2da0dbba" returned: 0 in 0.634s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:05 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Snapshot extracted, beginning image upload
Nov 08 18:38:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Snapshot image upload complete
Nov 08 18:38:08 user nova-compute[74820]: INFO nova.compute.manager [None req-8e07a44d-e3a0-4928-bf0b-f00a9dc312ed tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Took 6.54 seconds to snapshot the instance on the hypervisor.
Nov 08 18:38:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:38:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:38:22 user nova-compute[74820]: INFO nova.compute.claims [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Claim successful on node user
Nov 08 18:38:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:38:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.policy [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb2804c2bc374d52a2283e78f03959c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622d25fd48684d82bb673a57cf0a7928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:38:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Creating image(s)
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:38:23 user nova-compute[74820]: INFO nova.compute.claims [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Claim successful on node user
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk 1073741824" returned: 0 in 0.061s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Successfully created port: 0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Cannot resize image /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Ensure instance console log exists: /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:38:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.policy [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb2804c2bc374d52a2283e78f03959c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622d25fd48684d82bb673a57cf0a7928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:38:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Creating image(s)
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Successfully updated port: 0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-changed-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Refreshing instance network info cache due to event network-changed-0096d7ac-f51d-46f5-add9-59141b6a0588. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk 1073741824" returned: 0 in 0.055s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance network_info: |[{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Refreshing network info cache for port 0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Start _get_guest_xml network_info=[{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2136003210',display_name='tempest-ServerRescueNegativeTestJSON-server-2136003210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2136003210',id=26,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-iicek56j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:23Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=81728aff-572d-4015-b0a4-c299022d4ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'pci_devices' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:38:25 user nova-compute[74820]:   <uuid>81728aff-572d-4015-b0a4-c299022d4ea1</uuid>
Nov 08 18:38:25 user nova-compute[74820]:   <name>instance-0000001a</name>
Nov 08 18:38:25 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:38:25 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:38:25 user nova-compute[74820]:   <metadata>
Nov 08 18:38:25 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:38:25 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:38:25 user nova-compute[74820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2136003210</nova:name>
Nov 08 18:38:25 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:38:25</nova:creationTime>
Nov 08 18:38:25 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:38:25 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:38:25 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:38:25 user nova-compute[74820]:       <nova:owner>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:user uuid="cb2804c2bc374d52a2283e78f03959c6">tempest-ServerRescueNegativeTestJSON-1619361117-project-member</nova:user>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:project uuid="622d25fd48684d82bb673a57cf0a7928">tempest-ServerRescueNegativeTestJSON-1619361117</nova:project>
Nov 08 18:38:25 user nova-compute[74820]:       </nova:owner>
Nov 08 18:38:25 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:38:25 user nova-compute[74820]:       <nova:ports>
Nov 08 18:38:25 user nova-compute[74820]:         <nova:port uuid="0096d7ac-f51d-46f5-add9-59141b6a0588">
Nov 08 18:38:25 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 18:38:25 user nova-compute[74820]:         </nova:port>
Nov 08 18:38:25 user nova-compute[74820]:       </nova:ports>
Nov 08 18:38:25 user nova-compute[74820]:     </nova:instance>
Nov 08 18:38:25 user nova-compute[74820]:   </metadata>
Nov 08 18:38:25 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:38:25 user nova-compute[74820]:     <system>
Nov 08 18:38:25 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:38:25 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:38:25 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:38:25 user nova-compute[74820]:       <entry name="serial">81728aff-572d-4015-b0a4-c299022d4ea1</entry>
Nov 08 18:38:25 user nova-compute[74820]:       <entry name="uuid">81728aff-572d-4015-b0a4-c299022d4ea1</entry>
Nov 08 18:38:25 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:38:25 user nova-compute[74820]:     </system>
Nov 08 18:38:25 user nova-compute[74820]:   </sysinfo>
Nov 08 18:38:25 user nova-compute[74820]:   <os>
Nov 08 18:38:25 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:38:25 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:38:25 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:38:25 user nova-compute[74820]:   </os>
Nov 08 18:38:25 user nova-compute[74820]:   <features>
Nov 08 18:38:25 user nova-compute[74820]:     <acpi/>
Nov 08 18:38:25 user nova-compute[74820]:     <apic/>
Nov 08 18:38:25 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:38:25 user nova-compute[74820]:   </features>
Nov 08 18:38:25 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:38:25 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:38:25 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:38:25 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:38:25 user nova-compute[74820]:   </clock>
Nov 08 18:38:25 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:38:25 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:38:25 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:38:25 user nova-compute[74820]:   </cpu>
Nov 08 18:38:25 user nova-compute[74820]:   <devices>
Nov 08 18:38:25 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:38:25 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:38:25 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk"/>
Nov 08 18:38:25 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:38:25 user nova-compute[74820]:     </disk>
Nov 08 18:38:25 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:38:25 user nova-compute[74820]:       <mac address="fa:16:3e:91:fc:b8"/>
Nov 08 18:38:25 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:25 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:38:25 user nova-compute[74820]:       <target dev="tap0096d7ac-f5"/>
Nov 08 18:38:25 user nova-compute[74820]:     </interface>
Nov 08 18:38:25 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:38:25 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/console.log" append="off"/>
Nov 08 18:38:25 user nova-compute[74820]:     </serial>
Nov 08 18:38:25 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:38:25 user nova-compute[74820]:     <video>
Nov 08 18:38:25 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:25 user nova-compute[74820]:     </video>
Nov 08 18:38:25 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:38:25 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:38:25 user nova-compute[74820]:     </rng>
Nov 08 18:38:25 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:38:25 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:38:25 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:38:25 user nova-compute[74820]:     </memballoon>
Nov 08 18:38:25 user nova-compute[74820]:   </devices>
Nov 08 18:38:25 user nova-compute[74820]: </domain>
Nov 08 18:38:25 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2136003210',display_name='tempest-ServerRescueNegativeTestJSON-server-2136003210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2136003210',id=26,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-iicek56j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:23Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=81728aff-572d-4015-b0a4-c299022d4ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG os_vif [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b42577ba-5328-5824-befe-8a33310030ea', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0096d7ac-f5, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0096d7ac-f5, col_values=(('qos', UUID('987aaa37-40d2-43bf-a0e5-a755d418bc8d')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0096d7ac-f5, col_values=(('external_ids', {'iface-id': '0096d7ac-f51d-46f5-add9-59141b6a0588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:fc:b8', 'vm-uuid': '81728aff-572d-4015-b0a4-c299022d4ea1'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Cannot resize image /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Ensure instance console log exists: /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:25 user nova-compute[74820]: INFO os_vif [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5')
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:91:fc:b8, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Successfully created port: dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:38:25 user nova-compute[74820]: INFO nova.compute.claims [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Claim successful on node user
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updated VIF entry in instance network info cache for port 0096d7ac-f51d-46f5-add9-59141b6a0588. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:38:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a55292b8-d185-4f74-b5e7-0e6ef41d55c6 req-23539d48-8f3d-4403-9fd2-8a5a1a27a7be service nova] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:38:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.policy [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c84ad1439444413bc8a2acfffff1f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '008fbbc99e0b4aca939d6338fdd7fa82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:38:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Creating image(s)
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "/opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "/opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "/opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.232s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk 1073741824" returned: 0 in 0.080s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Successfully created port: 81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Successfully updated port: dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.243s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-92ab895d-1c8e-4393-a5eb-cc3aa3b8c9aa req-5d91251c-9823-4e69-be1b-627a5294d6ec service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-92ab895d-1c8e-4393-a5eb-cc3aa3b8c9aa req-5d91251c-9823-4e69-be1b-627a5294d6ec service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-92ab895d-1c8e-4393-a5eb-cc3aa3b8c9aa req-5d91251c-9823-4e69-be1b-627a5294d6ec service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-92ab895d-1c8e-4393-a5eb-cc3aa3b8c9aa req-5d91251c-9823-4e69-be1b-627a5294d6ec service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-92ab895d-1c8e-4393-a5eb-cc3aa3b8c9aa req-5d91251c-9823-4e69-be1b-627a5294d6ec service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:27 user nova-compute[74820]: WARNING nova.compute.manager [req-92ab895d-1c8e-4393-a5eb-cc3aa3b8c9aa req-5d91251c-9823-4e69-be1b-627a5294d6ec service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state building and task_state spawning.
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-changed-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Refreshing instance network info cache due to event network-changed-dffbecd7-0e8c-4bba-bb02-ac23604ded73. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] Acquiring lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Cannot resize image /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Ensure instance console log exists: /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance network_info: |[{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] Acquired lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Refreshing network info cache for port dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Start _get_guest_xml network_info=[{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-73105212',display_name='tempest-ServerRescueNegativeTestJSON-server-73105212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-73105212',id=27,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-icw14c7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:25Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=195fa78f-a73f-494e-b95b-41b5061326b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'pci_devices' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:38:27 user nova-compute[74820]:   <uuid>195fa78f-a73f-494e-b95b-41b5061326b2</uuid>
Nov 08 18:38:27 user nova-compute[74820]:   <name>instance-0000001b</name>
Nov 08 18:38:27 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:38:27 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:38:27 user nova-compute[74820]:   <metadata>
Nov 08 18:38:27 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:38:27 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:38:27 user nova-compute[74820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-73105212</nova:name>
Nov 08 18:38:27 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:38:27</nova:creationTime>
Nov 08 18:38:27 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:38:27 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:38:27 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:38:27 user nova-compute[74820]:       <nova:owner>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:user uuid="cb2804c2bc374d52a2283e78f03959c6">tempest-ServerRescueNegativeTestJSON-1619361117-project-member</nova:user>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:project uuid="622d25fd48684d82bb673a57cf0a7928">tempest-ServerRescueNegativeTestJSON-1619361117</nova:project>
Nov 08 18:38:27 user nova-compute[74820]:       </nova:owner>
Nov 08 18:38:27 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:38:27 user nova-compute[74820]:       <nova:ports>
Nov 08 18:38:27 user nova-compute[74820]:         <nova:port uuid="dffbecd7-0e8c-4bba-bb02-ac23604ded73">
Nov 08 18:38:27 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:38:27 user nova-compute[74820]:         </nova:port>
Nov 08 18:38:27 user nova-compute[74820]:       </nova:ports>
Nov 08 18:38:27 user nova-compute[74820]:     </nova:instance>
Nov 08 18:38:27 user nova-compute[74820]:   </metadata>
Nov 08 18:38:27 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:38:27 user nova-compute[74820]:     <system>
Nov 08 18:38:27 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:38:27 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:38:27 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:38:27 user nova-compute[74820]:       <entry name="serial">195fa78f-a73f-494e-b95b-41b5061326b2</entry>
Nov 08 18:38:27 user nova-compute[74820]:       <entry name="uuid">195fa78f-a73f-494e-b95b-41b5061326b2</entry>
Nov 08 18:38:27 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:38:27 user nova-compute[74820]:     </system>
Nov 08 18:38:27 user nova-compute[74820]:   </sysinfo>
Nov 08 18:38:27 user nova-compute[74820]:   <os>
Nov 08 18:38:27 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:38:27 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:38:27 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:38:27 user nova-compute[74820]:   </os>
Nov 08 18:38:27 user nova-compute[74820]:   <features>
Nov 08 18:38:27 user nova-compute[74820]:     <acpi/>
Nov 08 18:38:27 user nova-compute[74820]:     <apic/>
Nov 08 18:38:27 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:38:27 user nova-compute[74820]:   </features>
Nov 08 18:38:27 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:38:27 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:38:27 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:38:27 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:38:27 user nova-compute[74820]:   </clock>
Nov 08 18:38:27 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:38:27 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:38:27 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:38:27 user nova-compute[74820]:   </cpu>
Nov 08 18:38:27 user nova-compute[74820]:   <devices>
Nov 08 18:38:27 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:38:27 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:38:27 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk"/>
Nov 08 18:38:27 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:38:27 user nova-compute[74820]:     </disk>
Nov 08 18:38:27 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:38:27 user nova-compute[74820]:       <mac address="fa:16:3e:17:b6:1d"/>
Nov 08 18:38:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:27 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:38:27 user nova-compute[74820]:       <target dev="tapdffbecd7-0e"/>
Nov 08 18:38:27 user nova-compute[74820]:     </interface>
Nov 08 18:38:27 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:38:27 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/console.log" append="off"/>
Nov 08 18:38:27 user nova-compute[74820]:     </serial>
Nov 08 18:38:27 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:38:27 user nova-compute[74820]:     <video>
Nov 08 18:38:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:27 user nova-compute[74820]:     </video>
Nov 08 18:38:27 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:38:27 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:38:27 user nova-compute[74820]:     </rng>
Nov 08 18:38:27 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:38:27 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:38:27 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:38:27 user nova-compute[74820]:     </memballoon>
Nov 08 18:38:27 user nova-compute[74820]:   </devices>
Nov 08 18:38:27 user nova-compute[74820]: </domain>
Nov 08 18:38:27 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-73105212',display_name='tempest-ServerRescueNegativeTestJSON-server-73105212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-73105212',id=27,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-icw14c7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:25Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=195fa78f-a73f-494e-b95b-41b5061326b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG os_vif [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adab8c11-6c20-5bd4-a54c-4aad2124dc78', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdffbecd7-0e, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdffbecd7-0e, col_values=(('qos', UUID('63351e63-4d4d-4d27-8fc3-dd2687e72d0a')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdffbecd7-0e, col_values=(('external_ids', {'iface-id': 'dffbecd7-0e8c-4bba-bb02-ac23604ded73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:b6:1d', 'vm-uuid': '195fa78f-a73f-494e-b95b-41b5061326b2'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: INFO os_vif [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e')
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:17:b6:1d, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Successfully updated port: 81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "refresh_cache-11f4ce0b-0556-4a4f-8966-bc78e3ad6313" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquired lock "refresh_cache-11f4ce0b-0556-4a4f-8966-bc78e3ad6313" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.neutron [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updated VIF entry in instance network info cache for port dffbecd7-0e8c-4bba-bb02-ac23604ded73. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.neutron [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f4c0c31c-53e9-4cdb-a87c-721b45a0057f req-fff6173a-5c0f-443a-8b50-6470732ef228 service nova] Releasing lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Updating instance_info_cache with network_info: [{"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Releasing lock "refresh_cache-11f4ce0b-0556-4a4f-8966-bc78e3ad6313" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Instance network_info: |[{"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Start _get_guest_xml network_info=[{"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:38:28 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:28 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2083992474',display_name='tempest-VolumesAdminNegativeTest-server-2083992474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2083992474',id=28,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='008fbbc99e0b4aca939d6338fdd7fa82',ramdisk_id='',reservation_id='r-62a8tw5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571307425',owner_user_name='tempest-VolumesAdminNegativeTest-571307425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:27Z,user_data=None,user_id='3c84ad1439444413bc8a2acfffff1f2b',uuid=11f4ce0b-0556-4a4f-8966-bc78e3ad6313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converting VIF {"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'pci_devices' on Instance uuid 11f4ce0b-0556-4a4f-8966-bc78e3ad6313 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:38:28 user nova-compute[74820]:   <uuid>11f4ce0b-0556-4a4f-8966-bc78e3ad6313</uuid>
Nov 08 18:38:28 user nova-compute[74820]:   <name>instance-0000001c</name>
Nov 08 18:38:28 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:38:28 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:38:28 user nova-compute[74820]:   <metadata>
Nov 08 18:38:28 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:38:28 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:38:28 user nova-compute[74820]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2083992474</nova:name>
Nov 08 18:38:28 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:38:28</nova:creationTime>
Nov 08 18:38:28 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:38:28 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:38:28 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:38:28 user nova-compute[74820]:       <nova:owner>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:user uuid="3c84ad1439444413bc8a2acfffff1f2b">tempest-VolumesAdminNegativeTest-571307425-project-member</nova:user>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:project uuid="008fbbc99e0b4aca939d6338fdd7fa82">tempest-VolumesAdminNegativeTest-571307425</nova:project>
Nov 08 18:38:28 user nova-compute[74820]:       </nova:owner>
Nov 08 18:38:28 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:38:28 user nova-compute[74820]:       <nova:ports>
Nov 08 18:38:28 user nova-compute[74820]:         <nova:port uuid="81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b">
Nov 08 18:38:28 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:38:28 user nova-compute[74820]:         </nova:port>
Nov 08 18:38:28 user nova-compute[74820]:       </nova:ports>
Nov 08 18:38:28 user nova-compute[74820]:     </nova:instance>
Nov 08 18:38:28 user nova-compute[74820]:   </metadata>
Nov 08 18:38:28 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:38:28 user nova-compute[74820]:     <system>
Nov 08 18:38:28 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:38:28 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:38:28 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:38:28 user nova-compute[74820]:       <entry name="serial">11f4ce0b-0556-4a4f-8966-bc78e3ad6313</entry>
Nov 08 18:38:28 user nova-compute[74820]:       <entry name="uuid">11f4ce0b-0556-4a4f-8966-bc78e3ad6313</entry>
Nov 08 18:38:28 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:38:28 user nova-compute[74820]:     </system>
Nov 08 18:38:28 user nova-compute[74820]:   </sysinfo>
Nov 08 18:38:28 user nova-compute[74820]:   <os>
Nov 08 18:38:28 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:38:28 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:38:28 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:38:28 user nova-compute[74820]:   </os>
Nov 08 18:38:28 user nova-compute[74820]:   <features>
Nov 08 18:38:28 user nova-compute[74820]:     <acpi/>
Nov 08 18:38:28 user nova-compute[74820]:     <apic/>
Nov 08 18:38:28 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:38:28 user nova-compute[74820]:   </features>
Nov 08 18:38:28 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:38:28 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:38:28 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:38:28 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:38:28 user nova-compute[74820]:   </clock>
Nov 08 18:38:28 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:38:28 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:38:28 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:38:28 user nova-compute[74820]:   </cpu>
Nov 08 18:38:28 user nova-compute[74820]:   <devices>
Nov 08 18:38:28 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:38:28 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:38:28 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk"/>
Nov 08 18:38:28 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:38:28 user nova-compute[74820]:     </disk>
Nov 08 18:38:28 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:38:28 user nova-compute[74820]:       <mac address="fa:16:3e:d4:77:e1"/>
Nov 08 18:38:28 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:28 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:38:28 user nova-compute[74820]:       <target dev="tap81a6d63d-b7"/>
Nov 08 18:38:28 user nova-compute[74820]:     </interface>
Nov 08 18:38:28 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:38:28 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/console.log" append="off"/>
Nov 08 18:38:28 user nova-compute[74820]:     </serial>
Nov 08 18:38:28 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:38:28 user nova-compute[74820]:     <video>
Nov 08 18:38:28 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:28 user nova-compute[74820]:     </video>
Nov 08 18:38:28 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:38:28 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:38:28 user nova-compute[74820]:     </rng>
Nov 08 18:38:28 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:38:28 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:38:28 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:38:28 user nova-compute[74820]:     </memballoon>
Nov 08 18:38:28 user nova-compute[74820]:   </devices>
Nov 08 18:38:28 user nova-compute[74820]: </domain>
Nov 08 18:38:28 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2083992474',display_name='tempest-VolumesAdminNegativeTest-server-2083992474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2083992474',id=28,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='008fbbc99e0b4aca939d6338fdd7fa82',ramdisk_id='',reservation_id='r-62a8tw5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571307425',owner_user_name='tempest-VolumesAdminNegativeTest-571307425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:27Z,user_data=None,user_id='3c84ad1439444413bc8a2acfffff1f2b',uuid=11f4ce0b-0556-4a4f-8966-bc78e3ad6313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converting VIF {"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG os_vif [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69f72211-58b0-52ca-8b20-c60c2874da7a', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81a6d63d-b7, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81a6d63d-b7, col_values=(('qos', UUID('3d30e3ac-b292-4dcd-bb71-352c08e579b2')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81a6d63d-b7, col_values=(('external_ids', {'iface-id': '81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:77:e1', 'vm-uuid': '11f4ce0b-0556-4a4f-8966-bc78e3ad6313'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:28 user nova-compute[74820]: INFO os_vif [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7')
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:38:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] No VIF found with MAC fa:16:3e:d4:77:e1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:38:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance spawned successfully.
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:29 user nova-compute[74820]: INFO nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:38:29 user nova-compute[74820]: INFO nova.compute.manager [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Took 6.89 seconds to build instance.
Nov 08 18:38:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c99e844d-3835-4167-9ebe-e1e98b2a27d6 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.998s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:29 user nova-compute[74820]: WARNING nova.compute.manager [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state active and task_state None.
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-changed-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Refreshing instance network info cache due to event network-changed-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] Acquiring lock "refresh_cache-11f4ce0b-0556-4a4f-8966-bc78e3ad6313" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] Acquired lock "refresh_cache-11f4ce0b-0556-4a4f-8966-bc78e3ad6313" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG nova.network.neutron [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Refreshing network info cache for port 81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG nova.network.neutron [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Updated VIF entry in instance network info cache for port 81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG nova.network.neutron [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Updating instance_info_cache with network_info: [{"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8793d68-7861-4cf1-9b7b-286e0fb3de2f req-701a7049-cb6d-4b6d-9a82-affd0fc3754e service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8793d68-7861-4cf1-9b7b-286e0fb3de2f req-701a7049-cb6d-4b6d-9a82-affd0fc3754e service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8793d68-7861-4cf1-9b7b-286e0fb3de2f req-701a7049-cb6d-4b6d-9a82-affd0fc3754e service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8793d68-7861-4cf1-9b7b-286e0fb3de2f req-701a7049-cb6d-4b6d-9a82-affd0fc3754e service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8793d68-7861-4cf1-9b7b-286e0fb3de2f req-701a7049-cb6d-4b6d-9a82-affd0fc3754e service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:30 user nova-compute[74820]: WARNING nova.compute.manager [req-a8793d68-7861-4cf1-9b7b-286e0fb3de2f req-701a7049-cb6d-4b6d-9a82-affd0fc3754e service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state building and task_state spawning.
Nov 08 18:38:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-32065c9a-5647-4519-a553-9d689c26f6e9 req-0fe2f5cb-c211-40c8-b814-4c06b6d9668d service nova] Releasing lock "refresh_cache-11f4ce0b-0556-4a4f-8966-bc78e3ad6313" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:32 user nova-compute[74820]: WARNING nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state building and task_state spawning.
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] No waiting events found dispatching network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:32 user nova-compute[74820]: WARNING nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received unexpected event network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b for instance with vm_state building and task_state spawning.
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] No waiting events found dispatching network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:32 user nova-compute[74820]: WARNING nova.compute.manager [req-14d4e02a-e7ec-4d98-b655-cc0d6d8b8a5e req-928d43b7-430d-4cc2-a5e2-7ca755dd611a service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received unexpected event network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b for instance with vm_state building and task_state spawning.
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:32 user nova-compute[74820]: INFO nova.compute.manager [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Unshelving
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'pci_requests' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:32 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:38:32 user nova-compute[74820]: INFO nova.compute.claims [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Claim successful on node user
Nov 08 18:38:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:33 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:38:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:38:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:33 user nova-compute[74820]: INFO nova.network.neutron [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 18:38:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:38:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:38:34 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance spawned successfully.
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: INFO nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Took 9.40 seconds to spawn the instance on the hypervisor.
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:38:34 user nova-compute[74820]: INFO nova.compute.manager [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Took 10.56 seconds to build instance.
Nov 08 18:38:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-180a1c3a-47c3-4077-a5be-7281baf09ffa tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.679s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:38:34 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Instance spawned successfully.
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing instance network info cache due to event network-changed-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:38:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:34 user nova-compute[74820]: INFO nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 08 18:38:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:38:34 user nova-compute[74820]: INFO nova.compute.manager [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Took 8.74 seconds to build instance.
Nov 08 18:38:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c31c9c60-a11f-40ee-867d-84dddd06179b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.872s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG nova.network.neutron [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:38:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Creating image(s)
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Refreshing network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<2c0484b3-8be4-430f-9436-1f2f095414f7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "78389dc666de8d1c06083c438e2c530941996ffd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "78389dc666de8d1c06083c438e2c530941996ffd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.part --force-share --output=json" returned: 0 in 0.265s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:36 user nova-compute[74820]: DEBUG nova.virt.images [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] 9e29a40b-f071-4d70-bc8f-9f5903a43d77 was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:38:36 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:38:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.part /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updated VIF entry in instance network info cache for port 784a7f5c-9e81-4ae6-a2ff-d687f6cab22d. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-13bc8a99-b18e-4fb4-828e-ead9770e30eb req-98de40f5-aed6-428e-9f66-c918dea0a634 service nova] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.part /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.converted" returned: 0 in 0.394s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd.converted --force-share --output=json" returned: 0 in 0.275s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "78389dc666de8d1c06083c438e2c530941996ffd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.456s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "78389dc666de8d1c06083c438e2c530941996ffd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "78389dc666de8d1c06083c438e2c530941996ffd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd --force-share --output=json" returned: 0 in 0.234s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd,backing_fmt=raw /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd,backing_fmt=raw /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk 1073741824" returned: 0 in 0.072s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "78389dc666de8d1c06083c438e2c530941996ffd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'migration_context' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<2c0484b3-8be4-430f-9436-1f2f095414f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:38:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Rebasing disk image.
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.313s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf -F raw /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf -F raw /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk" returned: 0 in 3.052s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Ensure instance console log exists: /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Start _get_guest_xml network_info=[{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9570ef3ba0e9c7f1687ce1ccf7e5f69e',container_format='bare',created_at=2023-11-08T18:36:38Z,direct_url=<?>,disk_format='qcow2',id=9e29a40b-f071-4d70-bc8f-9f5903a43d77,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-672706708-shelved',owner='80c3b99ebc044d32a5647dc7963f11ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T18:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:38:41 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:41 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9570ef3ba0e9c7f1687ce1ccf7e5f69e',container_format='bare',created_at=2023-11-08T18:36:38Z,direct_url=<?>,disk_format='qcow2',id=9e29a40b-f071-4d70-bc8f-9f5903a43d77,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-672706708-shelved',owner='80c3b99ebc044d32a5647dc7963f11ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T18:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.objects.base [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<2c0484b3-8be4-430f-9436-1f2f095414f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-672706708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-672706708',id=19,image_ref='9e29a40b-f071-4d70-bc8f-9f5903a43d77',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1190867603',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-mkchcuj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member',shelved_at='2023-11-08T18:36:43.958643',shelved_host='user',shelved_image_id='9e29a40b-f071-4d70-bc8f-9f5903a43d77'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=2c0484b3-8be4-430f-9436-1f2f095414f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.objects.base [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Object Instance<2c0484b3-8be4-430f-9436-1f2f095414f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:38:41 user nova-compute[74820]:   <uuid>2c0484b3-8be4-430f-9436-1f2f095414f7</uuid>
Nov 08 18:38:41 user nova-compute[74820]:   <name>instance-00000013</name>
Nov 08 18:38:41 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:38:41 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:38:41 user nova-compute[74820]:   <metadata>
Nov 08 18:38:41 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:38:41 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:38:41 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-672706708</nova:name>
Nov 08 18:38:41 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:38:41</nova:creationTime>
Nov 08 18:38:41 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:38:41 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:38:41 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:38:41 user nova-compute[74820]:       <nova:owner>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:user uuid="6adeab5384fc4d8fad36575d715cf133">tempest-AttachVolumeShelveTestJSON-1684933452-project-member</nova:user>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:project uuid="80c3b99ebc044d32a5647dc7963f11ae">tempest-AttachVolumeShelveTestJSON-1684933452</nova:project>
Nov 08 18:38:41 user nova-compute[74820]:       </nova:owner>
Nov 08 18:38:41 user nova-compute[74820]:       <nova:root type="image" uuid="9e29a40b-f071-4d70-bc8f-9f5903a43d77"/>
Nov 08 18:38:41 user nova-compute[74820]:       <nova:ports>
Nov 08 18:38:41 user nova-compute[74820]:         <nova:port uuid="784a7f5c-9e81-4ae6-a2ff-d687f6cab22d">
Nov 08 18:38:41 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 18:38:41 user nova-compute[74820]:         </nova:port>
Nov 08 18:38:41 user nova-compute[74820]:       </nova:ports>
Nov 08 18:38:41 user nova-compute[74820]:     </nova:instance>
Nov 08 18:38:41 user nova-compute[74820]:   </metadata>
Nov 08 18:38:41 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:38:41 user nova-compute[74820]:     <system>
Nov 08 18:38:41 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:38:41 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:38:41 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:38:41 user nova-compute[74820]:       <entry name="serial">2c0484b3-8be4-430f-9436-1f2f095414f7</entry>
Nov 08 18:38:41 user nova-compute[74820]:       <entry name="uuid">2c0484b3-8be4-430f-9436-1f2f095414f7</entry>
Nov 08 18:38:41 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:38:41 user nova-compute[74820]:     </system>
Nov 08 18:38:41 user nova-compute[74820]:   </sysinfo>
Nov 08 18:38:41 user nova-compute[74820]:   <os>
Nov 08 18:38:41 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:38:41 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:38:41 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:38:41 user nova-compute[74820]:   </os>
Nov 08 18:38:41 user nova-compute[74820]:   <features>
Nov 08 18:38:41 user nova-compute[74820]:     <acpi/>
Nov 08 18:38:41 user nova-compute[74820]:     <apic/>
Nov 08 18:38:41 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:38:41 user nova-compute[74820]:   </features>
Nov 08 18:38:41 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:38:41 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:38:41 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:38:41 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:38:41 user nova-compute[74820]:   </clock>
Nov 08 18:38:41 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:38:41 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:38:41 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:38:41 user nova-compute[74820]:   </cpu>
Nov 08 18:38:41 user nova-compute[74820]:   <devices>
Nov 08 18:38:41 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:38:41 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:38:41 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk"/>
Nov 08 18:38:41 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:38:41 user nova-compute[74820]:     </disk>
Nov 08 18:38:41 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:38:41 user nova-compute[74820]:       <mac address="fa:16:3e:87:bc:ee"/>
Nov 08 18:38:41 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:41 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:38:41 user nova-compute[74820]:       <target dev="tap784a7f5c-9e"/>
Nov 08 18:38:41 user nova-compute[74820]:     </interface>
Nov 08 18:38:41 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:38:41 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/console.log" append="off"/>
Nov 08 18:38:41 user nova-compute[74820]:     </serial>
Nov 08 18:38:41 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:38:41 user nova-compute[74820]:     <video>
Nov 08 18:38:41 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:41 user nova-compute[74820]:     </video>
Nov 08 18:38:41 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:38:41 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:38:41 user nova-compute[74820]:     </rng>
Nov 08 18:38:41 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:38:41 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:38:41 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:38:41 user nova-compute[74820]:     </memballoon>
Nov 08 18:38:41 user nova-compute[74820]:   </devices>
Nov 08 18:38:41 user nova-compute[74820]: </domain>
Nov 08 18:38:41 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-672706708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-672706708',id=19,image_ref='9e29a40b-f071-4d70-bc8f-9f5903a43d77',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1190867603',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-mkchcuj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member',shelved_at='2023-11-08T18:36:43.958643',shelved_host='user',shelved_image_id='9e29a40b-f071-4d70-bc8f-9f5903a43d77'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=2c0484b3-8be4-430f-9436-1f2f095414f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG os_vif [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f57d10c1-1882-548f-aeb8-dc35b6832fec', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap784a7f5c-9e, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap784a7f5c-9e, col_values=(('qos', UUID('717bfb6c-f25f-4655-aeaa-902e6eed1df1')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap784a7f5c-9e, col_values=(('external_ids', {'iface-id': '784a7f5c-9e81-4ae6-a2ff-d687f6cab22d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:bc:ee', 'vm-uuid': '2c0484b3-8be4-430f-9436-1f2f095414f7'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:41 user nova-compute[74820]: INFO os_vif [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e')
Nov 08 18:38:41 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:38:41 user nova-compute[74820]: INFO nova.compute.claims [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Claim successful on node user
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] No VIF found with MAC fa:16:3e:87:bc:ee, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.798s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:38:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.policy [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67910c8b82124239a88bd5d1153e6365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea7b7c3bcf4b469efa9d092e0a54f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:38:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Creating image(s)
Nov 08 18:38:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "/opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "/opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "/opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.299s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk 1073741824" returned: 0 in 0.052s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Successfully created port: 68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Cannot resize image /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Ensure instance console log exists: /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-227e6dc7-42b7-4e6b-803e-ffacf894114c req-b8b14b22-641c-44c9-bf30-2a033cf71ab0 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-227e6dc7-42b7-4e6b-803e-ffacf894114c req-b8b14b22-641c-44c9-bf30-2a033cf71ab0 service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-227e6dc7-42b7-4e6b-803e-ffacf894114c req-b8b14b22-641c-44c9-bf30-2a033cf71ab0 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-227e6dc7-42b7-4e6b-803e-ffacf894114c req-b8b14b22-641c-44c9-bf30-2a033cf71ab0 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-227e6dc7-42b7-4e6b-803e-ffacf894114c req-b8b14b22-641c-44c9-bf30-2a033cf71ab0 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:44 user nova-compute[74820]: WARNING nova.compute.manager [req-227e6dc7-42b7-4e6b-803e-ffacf894114c req-b8b14b22-641c-44c9-bf30-2a033cf71ab0 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 18:38:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Successfully updated port: 68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "refresh_cache-021fc1ed-45b7-4473-b1a2-b59d2d928e2f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquired lock "refresh_cache-021fc1ed-45b7-4473-b1a2-b59d2d928e2f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-changed-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Refreshing instance network info cache due to event network-changed-68d7a840-c915-491a-859e-52a69c90abae. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] Acquiring lock "refresh_cache-021fc1ed-45b7-4473-b1a2-b59d2d928e2f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Updating instance_info_cache with network_info: [{"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Releasing lock "refresh_cache-021fc1ed-45b7-4473-b1a2-b59d2d928e2f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Instance network_info: |[{"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] Acquired lock "refresh_cache-021fc1ed-45b7-4473-b1a2-b59d2d928e2f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Refreshing network info cache for port 68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Start _get_guest_xml network_info=[{"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:38:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-594433347',display_name='tempest-VolumesActionsTest-instance-594433347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-594433347',id=29,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05ea7b7c3bcf4b469efa9d092e0a54f6',ramdisk_id='',reservation_id='r-fe7u0l4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1331237735',owner_user_name='tempest-VolumesActionsTest-1331237735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:43Z,user_data=None,user_id='67910c8b82124239a88bd5d1153e6365',uuid=021fc1ed-45b7-4473-b1a2-b59d2d928e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converting VIF {"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lazy-loading 'pci_devices' on Instance uuid 021fc1ed-45b7-4473-b1a2-b59d2d928e2f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:38:45 user nova-compute[74820]:   <uuid>021fc1ed-45b7-4473-b1a2-b59d2d928e2f</uuid>
Nov 08 18:38:45 user nova-compute[74820]:   <name>instance-0000001d</name>
Nov 08 18:38:45 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:38:45 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:38:45 user nova-compute[74820]:   <metadata>
Nov 08 18:38:45 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:38:45 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:38:45 user nova-compute[74820]:       <nova:name>tempest-VolumesActionsTest-instance-594433347</nova:name>
Nov 08 18:38:45 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:38:45</nova:creationTime>
Nov 08 18:38:45 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:38:45 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:38:45 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:38:45 user nova-compute[74820]:       <nova:owner>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:user uuid="67910c8b82124239a88bd5d1153e6365">tempest-VolumesActionsTest-1331237735-project-member</nova:user>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:project uuid="05ea7b7c3bcf4b469efa9d092e0a54f6">tempest-VolumesActionsTest-1331237735</nova:project>
Nov 08 18:38:45 user nova-compute[74820]:       </nova:owner>
Nov 08 18:38:45 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:38:45 user nova-compute[74820]:       <nova:ports>
Nov 08 18:38:45 user nova-compute[74820]:         <nova:port uuid="68d7a840-c915-491a-859e-52a69c90abae">
Nov 08 18:38:45 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:38:45 user nova-compute[74820]:         </nova:port>
Nov 08 18:38:45 user nova-compute[74820]:       </nova:ports>
Nov 08 18:38:45 user nova-compute[74820]:     </nova:instance>
Nov 08 18:38:45 user nova-compute[74820]:   </metadata>
Nov 08 18:38:45 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:38:45 user nova-compute[74820]:     <system>
Nov 08 18:38:45 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:38:45 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:38:45 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:38:45 user nova-compute[74820]:       <entry name="serial">021fc1ed-45b7-4473-b1a2-b59d2d928e2f</entry>
Nov 08 18:38:45 user nova-compute[74820]:       <entry name="uuid">021fc1ed-45b7-4473-b1a2-b59d2d928e2f</entry>
Nov 08 18:38:45 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:38:45 user nova-compute[74820]:     </system>
Nov 08 18:38:45 user nova-compute[74820]:   </sysinfo>
Nov 08 18:38:45 user nova-compute[74820]:   <os>
Nov 08 18:38:45 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:38:45 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:38:45 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:38:45 user nova-compute[74820]:   </os>
Nov 08 18:38:45 user nova-compute[74820]:   <features>
Nov 08 18:38:45 user nova-compute[74820]:     <acpi/>
Nov 08 18:38:45 user nova-compute[74820]:     <apic/>
Nov 08 18:38:45 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:38:45 user nova-compute[74820]:   </features>
Nov 08 18:38:45 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:38:45 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:38:45 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:38:45 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:38:45 user nova-compute[74820]:   </clock>
Nov 08 18:38:45 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:38:45 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:38:45 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:38:45 user nova-compute[74820]:   </cpu>
Nov 08 18:38:45 user nova-compute[74820]:   <devices>
Nov 08 18:38:45 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:38:45 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:38:45 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk"/>
Nov 08 18:38:45 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:38:45 user nova-compute[74820]:     </disk>
Nov 08 18:38:45 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:38:45 user nova-compute[74820]:       <mac address="fa:16:3e:75:f9:87"/>
Nov 08 18:38:45 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:45 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:38:45 user nova-compute[74820]:       <target dev="tap68d7a840-c9"/>
Nov 08 18:38:45 user nova-compute[74820]:     </interface>
Nov 08 18:38:45 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:38:45 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/console.log" append="off"/>
Nov 08 18:38:45 user nova-compute[74820]:     </serial>
Nov 08 18:38:45 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:38:45 user nova-compute[74820]:     <video>
Nov 08 18:38:45 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:38:45 user nova-compute[74820]:     </video>
Nov 08 18:38:45 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:38:45 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:38:45 user nova-compute[74820]:     </rng>
Nov 08 18:38:45 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:38:45 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:38:45 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:38:45 user nova-compute[74820]:     </memballoon>
Nov 08 18:38:45 user nova-compute[74820]:   </devices>
Nov 08 18:38:45 user nova-compute[74820]: </domain>
Nov 08 18:38:45 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-594433347',display_name='tempest-VolumesActionsTest-instance-594433347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-594433347',id=29,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05ea7b7c3bcf4b469efa9d092e0a54f6',ramdisk_id='',reservation_id='r-fe7u0l4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1331237735',owner_user_name='tempest-VolumesActionsTest-1331237735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:43Z,user_data=None,user_id='67910c8b82124239a88bd5d1153e6365',uuid=021fc1ed-45b7-4473-b1a2-b59d2d928e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converting VIF {"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG os_vif [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73047dd4-ae1f-5c97-836c-d3ee5acccb55', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68d7a840-c9, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68d7a840-c9, col_values=(('qos', UUID('98468ee0-d4fe-4413-9ad1-86244f55f118')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68d7a840-c9, col_values=(('external_ids', {'iface-id': '68d7a840-c915-491a-859e-52a69c90abae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:f9:87', 'vm-uuid': '021fc1ed-45b7-4473-b1a2-b59d2d928e2f'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:45 user nova-compute[74820]: INFO os_vif [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9')
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] No VIF found with MAC fa:16:3e:75:f9:87, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Updated VIF entry in instance network info cache for port 68d7a840-c915-491a-859e-52a69c90abae. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:38:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Updating instance_info_cache with network_info: [{"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-effabfe3-6c5b-42de-808d-846868a52053 req-73a1b140-9ea1-4c25-829f-85c45caaa326 service nova] Releasing lock "refresh_cache-021fc1ed-45b7-4473-b1a2-b59d2d928e2f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-b39e9624-145e-46c3-aa16-88b75346cd47 req-0edbf636-0ca6-4d29-9ceb-2e87f38a675f service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b39e9624-145e-46c3-aa16-88b75346cd47 req-0edbf636-0ca6-4d29-9ceb-2e87f38a675f service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b39e9624-145e-46c3-aa16-88b75346cd47 req-0edbf636-0ca6-4d29-9ceb-2e87f38a675f service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b39e9624-145e-46c3-aa16-88b75346cd47 req-0edbf636-0ca6-4d29-9ceb-2e87f38a675f service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-b39e9624-145e-46c3-aa16-88b75346cd47 req-0edbf636-0ca6-4d29-9ceb-2e87f38a675f service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:46 user nova-compute[74820]: WARNING nova.compute.manager [req-b39e9624-145e-46c3-aa16-88b75346cd47 req-0edbf636-0ca6-4d29-9ceb-2e87f38a675f service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 18:38:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:38:46 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance spawned successfully.
Nov 08 18:38:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:38:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0329001c-1053-4a10-83a7-9de4cfda9c4c tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.978s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:38:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] No waiting events found dispatching network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:48 user nova-compute[74820]: WARNING nova.compute.manager [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received unexpected event network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae for instance with vm_state building and task_state spawning.
Nov 08 18:38:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] No waiting events found dispatching network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:38:48 user nova-compute[74820]: WARNING nova.compute.manager [req-061e8ee1-dd92-4080-8fcc-8b63abd47e63 req-47dbeb2d-93d3-4a63-b656-6072a97bc504 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received unexpected event network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae for instance with vm_state building and task_state spawning.
Nov 08 18:38:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:38:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Instance spawned successfully.
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:38:49 user nova-compute[74820]: INFO nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 08 18:38:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:38:49 user nova-compute[74820]: INFO nova.compute.manager [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Took 8.04 seconds to build instance.
Nov 08 18:38:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b459df51-ce4a-45b6-b057-a60e52e1574d tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.212s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:49 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:38:50 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:51 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:38:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:38:57 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:57 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:38:57 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7360MB free_disk=25.10369110107422GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:38:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:38:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 490de0ea-289a-45aa-bb05-14fb138fb833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d4bbc087-e9df-431d-9c42-9e10718e7e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 11f4ce0b-0556-4a4f-8966-bc78e3ad6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2c0484b3-8be4-430f-9436-1f2f095414f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 021fc1ed-45b7-4473-b1a2-b59d2d928e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:38:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.924s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:39:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updating instance_info_cache with network_info: [{"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d59095c8-d793-4257-a980-63be74e48c7a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:39:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:39:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:39:11 user nova-compute[74820]: INFO nova.compute.claims [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Claim successful on node user
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:39:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:39:11 user nova-compute[74820]: DEBUG nova.policy [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5790613f8a24f52897aedd0634f7f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77a76c049904c6abe35b10929563c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:39:11 user nova-compute[74820]: INFO nova.virt.block_device [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Booting with volume-backed-image 71d031e1-e4c3-46c0-bfb5-c8044e0fbc93 at /dev/vda
Nov 08 18:39:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Successfully created port: 678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Successfully updated port: 678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-changed-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Refreshing instance network info cache due to event network-changed-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] Acquiring lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updating instance_info_cache with network_info: [{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance network_info: |[{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] Acquired lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:13 user nova-compute[74820]: DEBUG nova.network.neutron [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Refreshing network info cache for port 678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:39:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updated VIF entry in instance network info cache for port 678c07b1-4c05-45b8-b2b8-b3aaff3d16ee. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:39:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updating instance_info_cache with network_info: [{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-54545d5d-693f-4033-afa2-3ca4108a6b77 req-b4fb6dd2-3b09-47c3-a0ee-6ea0836531c7 service nova] Releasing lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:39:17 user nova-compute[74820]: INFO nova.compute.claims [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Claim successful on node user
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:39:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG nova.policy [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a29988069fd43e0bfdb7b08a1fcc5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cdef93b9fc745768902ae1afe39ae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:39:17 user nova-compute[74820]: INFO nova.virt.block_device [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Booting with volume 100ca020-7a2a-4d32-b938-a203dec6a8e8 at /dev/vda
Nov 08 18:39:17 user nova-compute[74820]: DEBUG os_brick.utils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1c6e0-a8dc-479b-a2ae-80a4930977ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[983deab2-f465-496f-b022-f43561aa022e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1163a697-33b1-40b8-8b6a-5b87649f7318]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5ec4b-65b2-4b3f-95a3-f5e99151b1dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:39:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:18 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:39:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e16f5d-d4ec-4e68-9ba8-9f0ad7d687e1]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG os_brick.utils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating existing volume attachment record: f07ad287-1f2a-41ab-9f65-b5163afa614f {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Successfully created port: 9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Successfully updated port: 9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquired lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-changed-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Refreshing instance network info cache due to event network-changed-9695cc5e-3d41-4296-80f2-1b5dbfd7192a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] Acquiring lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Releasing lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance network_info: |[{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] Acquired lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Refreshing network info cache for port 9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:39:19 user nova-compute[74820]: INFO nova.compute.claims [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Claim successful on node user
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updated VIF entry in instance network info cache for port 9695cc5e-3d41-4296-80f2-1b5dbfd7192a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-98036cbd-13ea-469f-b970-7b5395174d8b req-ac3539f2-2662-4e1e-a76e-982e3b8ebf1f service nova] Releasing lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:39:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:39:20 user nova-compute[74820]: INFO nova.virt.block_device [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Booting with volume b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 at /dev/vda
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.policy [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d80baca13c04f37b8ea3d651536cdfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ad38240d754655a8f23b1dbc581507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG os_brick.utils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc29fb-2bb9-4817-b14d-d8620686b3dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a10bc63-ad84-46cd-bc8e-86feebbc2d90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01c3276-539a-4437-a44a-80bd4a9f585d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6f7ea7-4dec-4351-920a-6d1e6dfd4177]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:20 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:39:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7ca8a1-a894-4278-b5b6-26e9a638faa4]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG os_brick.utils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updating existing volume attachment record: f19c25d5-6b5d-4389-81fe-863d2d888307 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:39:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Successfully created port: 0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:39:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Successfully updated port: 0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquired lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-changed-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Refreshing instance network info cache due to event network-changed-0f4ed3b8-25d2-47be-ba55-a7183934daab. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] Acquiring lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updating instance_info_cache with network_info: [{"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Releasing lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Instance network_info: |[{"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] Acquired lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Refreshing network info cache for port 0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updated VIF entry in instance network info cache for port 0f4ed3b8-25d2-47be-ba55-a7183934daab. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updating instance_info_cache with network_info: [{"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e45e33c5-2fa0-41d1-a301-bdd542012bb7 req-696302c6-1ff2-4786-8e50-e604fc717074 service nova] Releasing lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e176afd-eef2-4320-ae6a-c80352b10240]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae77beb-ef84-4b24-a2d8-d3fefc7a9bd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae02f5d-19be-44e5-8930-8b8af40572b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7db6df-2b63-43b1-ab60-1826f1f338ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:32 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:39:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff9abc-5a6b-4a00-8ee2-87da9d86e2dc]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:39:32 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updating existing volume attachment record: 272f9a19-2029-4fda-825f-5b9bc446b460 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:39:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-changed-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Refreshing instance network info cache due to event network-changed-b4db4a79-3abf-4e9a-808e-9d7a1e43c754. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] Acquiring lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] Acquired lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG nova.network.neutron [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Refreshing network info cache for port b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG nova.network.neutron [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updated VIF entry in instance network info cache for port b4db4a79-3abf-4e9a-808e-9d7a1e43c754. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG nova.network.neutron [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updating instance_info_cache with network_info: [{"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5d4d4a51-41d6-4965-b0cb-779161896171 req-e67ea877-1409-459d-9e6a-5c1c93acab48 service nova] Releasing lock "refresh_cache-94ab5fd7-d916-440a-8cfb-6a7572c242e3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:39:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.objects.instance [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'flavor' on Instance uuid 94ab5fd7-d916-440a-8cfb-6a7572c242e3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:39:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Ignoring supplied device name: /dev/vdb
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:39:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Creating image(s)
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Ensure instance console log exists: /opt/stack/data/nova/instances/86e06d0a-11c1-4e80-8592-b71f37124e6c/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Start _get_guest_xml network_info=[{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'f07ad287-1f2a-41ab-9f65-b5163afa614f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86e06d0a-11c1-4e80-8592-b71f37124e6c', 'attached_at': '', 'detached_at': '', 'volume_id': '100ca020-7a2a-4d32-b938-a203dec6a8e8', 'serial': '100ca020-7a2a-4d32-b938-a203dec6a8e8'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:39:42 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:39:42 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:39:42 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:39:42 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:39:42 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79900bbc-aaef-404a-aff7-0f883cabb016]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:39:42 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:42 user nova-compute[74820]: INFO nova.compute.manager [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Attaching volume 039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 to /dev/vdb
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bddffc-5edd-4f5e-b62b-46a1f0b5fd02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8] added
Nov 08 18:39:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a3f72c-6932-491e-a570-c650e6a9adf4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b9c8e5-6bcb-4e0a-8f76-60cfda3687a6]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWSIhZqN {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWSIhZqN" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[27da9665-6545-4cfa-951c-3e582fb834f5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWSIhZqN'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed533e-d97f-47f4-88ea-8e240f20a3b7]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.utils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[566c942f-a792-4e3c-ae30-c9593a2407a5]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7298fc84-1e66-4bdc-b135-ed2d27838f79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1ed67c-fb27-4fad-9dbc-d7f753fcd94d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2258a0d-23e0-4e0a-b8ae-0f30d8e6ba60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541b824-5100-44df-acc6-dc26a7d8cfa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5c5888-60e7-48cd-8970-e64932f2817d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]
Nov 08 18:39:42 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.
Nov 08 18:39:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:39:42 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b550a9-6423-43dd-b74f-a5cba8c8943c]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.utils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updating existing volume attachment record: 51c24b3f-917d-4fce-ba5f-c7e2d2a38cb5 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d1fe8b-91ed-4682-8b1e-803cb05fe531]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd266ff-3636-4fc7-9be0-704e6fb6174a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:39:42 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:39:42 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:42 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc5f09-b84e-4c7a-9082-4779fad09eff]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:39:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:39:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:39:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23439386536646661', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:39:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439386536646661', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-506693465',display_name='tempest-ServerActionsTestOtherA-server-506693465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-506693465',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-yehjp0wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=86e06d0a-11c1-4e80-8592-b71f37124e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e06d0a-11c1-4e80-8592-b71f37124e6c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:39:44 user nova-compute[74820]:   <uuid>86e06d0a-11c1-4e80-8592-b71f37124e6c</uuid>
Nov 08 18:39:44 user nova-compute[74820]:   <name>instance-0000001f</name>
Nov 08 18:39:44 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:39:44 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:39:44 user nova-compute[74820]:   <metadata>
Nov 08 18:39:44 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:39:44 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:39:44 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherA-server-506693465</nova:name>
Nov 08 18:39:44 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:39:42</nova:creationTime>
Nov 08 18:39:44 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:39:44 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:39:44 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:39:44 user nova-compute[74820]:       <nova:owner>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:user uuid="1a29988069fd43e0bfdb7b08a1fcc5d9">tempest-ServerActionsTestOtherA-600897548-project-member</nova:user>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:project uuid="4cdef93b9fc745768902ae1afe39ae4a">tempest-ServerActionsTestOtherA-600897548</nova:project>
Nov 08 18:39:44 user nova-compute[74820]:       </nova:owner>
Nov 08 18:39:44 user nova-compute[74820]:       <nova:ports>
Nov 08 18:39:44 user nova-compute[74820]:         <nova:port uuid="9695cc5e-3d41-4296-80f2-1b5dbfd7192a">
Nov 08 18:39:44 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:39:44 user nova-compute[74820]:         </nova:port>
Nov 08 18:39:44 user nova-compute[74820]:       </nova:ports>
Nov 08 18:39:44 user nova-compute[74820]:     </nova:instance>
Nov 08 18:39:44 user nova-compute[74820]:   </metadata>
Nov 08 18:39:44 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:39:44 user nova-compute[74820]:     <system>
Nov 08 18:39:44 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:39:44 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:39:44 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:39:44 user nova-compute[74820]:       <entry name="serial">86e06d0a-11c1-4e80-8592-b71f37124e6c</entry>
Nov 08 18:39:44 user nova-compute[74820]:       <entry name="uuid">86e06d0a-11c1-4e80-8592-b71f37124e6c</entry>
Nov 08 18:39:44 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:39:44 user nova-compute[74820]:     </system>
Nov 08 18:39:44 user nova-compute[74820]:   </sysinfo>
Nov 08 18:39:44 user nova-compute[74820]:   <os>
Nov 08 18:39:44 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:39:44 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:39:44 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:39:44 user nova-compute[74820]:   </os>
Nov 08 18:39:44 user nova-compute[74820]:   <features>
Nov 08 18:39:44 user nova-compute[74820]:     <acpi/>
Nov 08 18:39:44 user nova-compute[74820]:     <apic/>
Nov 08 18:39:44 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:39:44 user nova-compute[74820]:   </features>
Nov 08 18:39:44 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:39:44 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:39:44 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:39:44 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:39:44 user nova-compute[74820]:   </clock>
Nov 08 18:39:44 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:39:44 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:39:44 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:39:44 user nova-compute[74820]:   </cpu>
Nov 08 18:39:44 user nova-compute[74820]:   <devices>
Nov 08 18:39:44 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:39:44 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:39:44 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 18:39:44 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:39:44 user nova-compute[74820]:       <serial>100ca020-7a2a-4d32-b938-a203dec6a8e8</serial>
Nov 08 18:39:44 user nova-compute[74820]:     </disk>
Nov 08 18:39:44 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:39:44 user nova-compute[74820]:       <mac address="fa:16:3e:8f:84:ee"/>
Nov 08 18:39:44 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:39:44 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:39:44 user nova-compute[74820]:       <target dev="tap9695cc5e-3d"/>
Nov 08 18:39:44 user nova-compute[74820]:     </interface>
Nov 08 18:39:44 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:39:44 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/86e06d0a-11c1-4e80-8592-b71f37124e6c/console.log" append="off"/>
Nov 08 18:39:44 user nova-compute[74820]:     </serial>
Nov 08 18:39:44 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:39:44 user nova-compute[74820]:     <video>
Nov 08 18:39:44 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:39:44 user nova-compute[74820]:     </video>
Nov 08 18:39:44 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:39:44 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:39:44 user nova-compute[74820]:     </rng>
Nov 08 18:39:44 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:39:44 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:39:44 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:39:44 user nova-compute[74820]:     </memballoon>
Nov 08 18:39:44 user nova-compute[74820]:   </devices>
Nov 08 18:39:44 user nova-compute[74820]: </domain>
Nov 08 18:39:44 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-506693465',display_name='tempest-ServerActionsTestOtherA-server-506693465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-506693465',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-yehjp0wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=86e06d0a-11c1-4e80-8592-b71f37124e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG os_vif [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0646ec8-b195-51dd-b8a1-f3f4e8bd033f', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9695cc5e-3d, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9695cc5e-3d, col_values=(('qos', UUID('c77fd186-3782-4e7b-a2aa-3e55e883305e')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9695cc5e-3d, col_values=(('external_ids', {'iface-id': '9695cc5e-3d41-4296-80f2-1b5dbfd7192a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:84:ee', 'vm-uuid': '86e06d0a-11c1-4e80-8592-b71f37124e6c'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:44 user nova-compute[74820]: INFO os_vif [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d')
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:39:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No VIF found with MAC fa:16:3e:8f:84:ee, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:39:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Creating image(s)
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Ensure instance console log exists: /opt/stack/data/nova/instances/c9b0f5f4-1d2a-476c-8a31-56f2e87b676e/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Start _get_guest_xml network_info=[{"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'f19c25d5-6b5d-4389-81fe-863d2d888307', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbONDzVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9b0f5f4-1d2a-476c-8a31-56f2e87b676e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4764dd7-4eb1-4743-b1f5-b9ac32bcf802', 'serial': 'b4764dd7-4eb1-4743-b1f5-b9ac32bcf802'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:39:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:39:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbONDzVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:39:45 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:39:45 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:39:45 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[957b8fc6-cf88-429d-ba1d-391ef5c1d750]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:39:45 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4713c4-efb6-4c43-8310-e7a45cbde1ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802] added
Nov 08 18:39:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2489773-c8d7-4ab1-b24d-cbdbdd30f6b3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[384df53e-9b6b-474e-b3d3-71422663a993]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbONDzVy {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbONDzVy" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff79012-6bce-4cec-8251-4e58a7e7f801]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbONDzVy'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd997902-230d-49c6-9ae3-685f61a0f2a8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5be2e3-b6a9-4f3d-a7da-295154880988]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:39:45 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:39:45 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd40b8-78d0-4b36-8593-d7cd49869979]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260]
Nov 08 18:39:45 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260] successful.
Nov 08 18:39:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ef1e5-2906-4dfe-a5fe-e67c2458a35b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7e829-7ec7-499e-a19f-9506106e54d5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:39:45 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:39:45 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:39:45 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:39:45 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:39:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[796322c5-6746-4a7c-89a8-be1ec9ff7b60]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbONDzVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-131e990b-eb17-48fb-9e49-632982c38c8f req-35c6be50-ef88-40bd-8b3b-5f65c91e3f69 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-131e990b-eb17-48fb-9e49-632982c38c8f req-35c6be50-ef88-40bd-8b3b-5f65c91e3f69 service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-131e990b-eb17-48fb-9e49-632982c38c8f req-35c6be50-ef88-40bd-8b3b-5f65c91e3f69 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-131e990b-eb17-48fb-9e49-632982c38c8f req-35c6be50-ef88-40bd-8b3b-5f65c91e3f69 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-131e990b-eb17-48fb-9e49-632982c38c8f req-35c6be50-ef88-40bd-8b3b-5f65c91e3f69 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:39:45 user nova-compute[74820]: WARNING nova.compute.manager [req-131e990b-eb17-48fb-9e49-632982c38c8f req-35c6be50-ef88-40bd-8b3b-5f65c91e3f69 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state building and task_state spawning.
Nov 08 18:39:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23265316136393164', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265316136393164', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1810207759',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1810207759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1810207759',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCNp7+C0urhKQF7C46HH7koVvY+WMzFy/2NSAFcWG3E9E86T+qDorNHSJ42Wk7B2OtSL07qz15J9XjaYKlxWXMaxI2jLxGEMiI0FqWdzc9ghbxYoIzLrPWpk65tuOCD/Q==',key_name='tempest-keypair-18726973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-7qtp91us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=c9b0f5f4-1d2a-476c-8a31-56f2e87b676e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.objects.instance [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'pci_devices' on Instance uuid c9b0f5f4-1d2a-476c-8a31-56f2e87b676e {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:39:46 user nova-compute[74820]:   <uuid>c9b0f5f4-1d2a-476c-8a31-56f2e87b676e</uuid>
Nov 08 18:39:46 user nova-compute[74820]:   <name>instance-00000020</name>
Nov 08 18:39:46 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:39:46 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:39:46 user nova-compute[74820]:   <metadata>
Nov 08 18:39:46 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:39:46 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:39:46 user nova-compute[74820]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1810207759</nova:name>
Nov 08 18:39:46 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:39:45</nova:creationTime>
Nov 08 18:39:46 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:39:46 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:39:46 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:39:46 user nova-compute[74820]:       <nova:owner>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:user uuid="4d80baca13c04f37b8ea3d651536cdfd">tempest-TestVolumeBootPattern-1148056077-project-member</nova:user>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:project uuid="f2ad38240d754655a8f23b1dbc581507">tempest-TestVolumeBootPattern-1148056077</nova:project>
Nov 08 18:39:46 user nova-compute[74820]:       </nova:owner>
Nov 08 18:39:46 user nova-compute[74820]:       <nova:ports>
Nov 08 18:39:46 user nova-compute[74820]:         <nova:port uuid="0f4ed3b8-25d2-47be-ba55-a7183934daab">
Nov 08 18:39:46 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 18:39:46 user nova-compute[74820]:         </nova:port>
Nov 08 18:39:46 user nova-compute[74820]:       </nova:ports>
Nov 08 18:39:46 user nova-compute[74820]:     </nova:instance>
Nov 08 18:39:46 user nova-compute[74820]:   </metadata>
Nov 08 18:39:46 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:39:46 user nova-compute[74820]:     <system>
Nov 08 18:39:46 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:39:46 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:39:46 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:39:46 user nova-compute[74820]:       <entry name="serial">c9b0f5f4-1d2a-476c-8a31-56f2e87b676e</entry>
Nov 08 18:39:46 user nova-compute[74820]:       <entry name="uuid">c9b0f5f4-1d2a-476c-8a31-56f2e87b676e</entry>
Nov 08 18:39:46 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:39:46 user nova-compute[74820]:     </system>
Nov 08 18:39:46 user nova-compute[74820]:   </sysinfo>
Nov 08 18:39:46 user nova-compute[74820]:   <os>
Nov 08 18:39:46 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:39:46 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:39:46 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:39:46 user nova-compute[74820]:   </os>
Nov 08 18:39:46 user nova-compute[74820]:   <features>
Nov 08 18:39:46 user nova-compute[74820]:     <acpi/>
Nov 08 18:39:46 user nova-compute[74820]:     <apic/>
Nov 08 18:39:46 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:39:46 user nova-compute[74820]:   </features>
Nov 08 18:39:46 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:39:46 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:39:46 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:39:46 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:39:46 user nova-compute[74820]:   </clock>
Nov 08 18:39:46 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:39:46 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:39:46 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:39:46 user nova-compute[74820]:   </cpu>
Nov 08 18:39:46 user nova-compute[74820]:   <devices>
Nov 08 18:39:46 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:39:46 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:39:46 user nova-compute[74820]:       <source dev="/dev/sdc"/>
Nov 08 18:39:46 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:39:46 user nova-compute[74820]:       <serial>b4764dd7-4eb1-4743-b1f5-b9ac32bcf802</serial>
Nov 08 18:39:46 user nova-compute[74820]:     </disk>
Nov 08 18:39:46 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:39:46 user nova-compute[74820]:       <mac address="fa:16:3e:2f:fd:a3"/>
Nov 08 18:39:46 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:39:46 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:39:46 user nova-compute[74820]:       <target dev="tap0f4ed3b8-25"/>
Nov 08 18:39:46 user nova-compute[74820]:     </interface>
Nov 08 18:39:46 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:39:46 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/c9b0f5f4-1d2a-476c-8a31-56f2e87b676e/console.log" append="off"/>
Nov 08 18:39:46 user nova-compute[74820]:     </serial>
Nov 08 18:39:46 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:39:46 user nova-compute[74820]:     <video>
Nov 08 18:39:46 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:39:46 user nova-compute[74820]:     </video>
Nov 08 18:39:46 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:39:46 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:39:46 user nova-compute[74820]:     </rng>
Nov 08 18:39:46 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:39:46 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:39:46 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:39:46 user nova-compute[74820]:     </memballoon>
Nov 08 18:39:46 user nova-compute[74820]:   </devices>
Nov 08 18:39:46 user nova-compute[74820]: </domain>
Nov 08 18:39:46 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1810207759',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1810207759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1810207759',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCNp7+C0urhKQF7C46HH7koVvY+WMzFy/2NSAFcWG3E9E86T+qDorNHSJ42Wk7B2OtSL07qz15J9XjaYKlxWXMaxI2jLxGEMiI0FqWdzc9ghbxYoIzLrPWpk65tuOCD/Q==',key_name='tempest-keypair-18726973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-7qtp91us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=c9b0f5f4-1d2a-476c-8a31-56f2e87b676e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG os_vif [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ca8f617-ee13-5acf-9f0f-274335182297', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f4ed3b8-25, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f4ed3b8-25, col_values=(('qos', UUID('27d7fa39-f699-43fa-b254-54c7657a2343')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f4ed3b8-25, col_values=(('external_ids', {'iface-id': '0f4ed3b8-25d2-47be-ba55-a7183934daab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:fd:a3', 'vm-uuid': 'c9b0f5f4-1d2a-476c-8a31-56f2e87b676e'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:46 user nova-compute[74820]: INFO os_vif [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25')
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:39:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No VIF found with MAC fa:16:3e:2f:fd:a3, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:39:47 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance spawned successfully.
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-efbd3659-5dc4-480e-96ef-9d0b0c3aefd9 req-b6f4f898-3657-41cb-9847-5b02a8c81997 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-efbd3659-5dc4-480e-96ef-9d0b0c3aefd9 req-b6f4f898-3657-41cb-9847-5b02a8c81997 service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-efbd3659-5dc4-480e-96ef-9d0b0c3aefd9 req-b6f4f898-3657-41cb-9847-5b02a8c81997 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-efbd3659-5dc4-480e-96ef-9d0b0c3aefd9 req-b6f4f898-3657-41cb-9847-5b02a8c81997 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-efbd3659-5dc4-480e-96ef-9d0b0c3aefd9 req-b6f4f898-3657-41cb-9847-5b02a8c81997 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:39:47 user nova-compute[74820]: WARNING nova.compute.manager [req-efbd3659-5dc4-480e-96ef-9d0b0c3aefd9 req-b6f4f898-3657-41cb-9847-5b02a8c81997 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state building and task_state spawning.
Nov 08 18:39:47 user nova-compute[74820]: INFO nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 08 18:39:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: INFO nova.compute.manager [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Took 31.08 seconds to build instance.
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d613a3f-0e6a-41df-be77-6d89eb054150 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.188s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-83da66ce-e200-4b6c-91c8-16e002869ef2 req-52605105-5295-4abc-8a7f-4d1ddf43d835 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83da66ce-e200-4b6c-91c8-16e002869ef2 req-52605105-5295-4abc-8a7f-4d1ddf43d835 service nova] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83da66ce-e200-4b6c-91c8-16e002869ef2 req-52605105-5295-4abc-8a7f-4d1ddf43d835 service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83da66ce-e200-4b6c-91c8-16e002869ef2 req-52605105-5295-4abc-8a7f-4d1ddf43d835 service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-83da66ce-e200-4b6c-91c8-16e002869ef2 req-52605105-5295-4abc-8a7f-4d1ddf43d835 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] No waiting events found dispatching network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:39:48 user nova-compute[74820]: WARNING nova.compute.manager [req-83da66ce-e200-4b6c-91c8-16e002869ef2 req-52605105-5295-4abc-8a7f-4d1ddf43d835 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received unexpected event network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab for instance with vm_state building and task_state spawning.
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:48 user nova-compute[74820]: INFO nova.compute.manager [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Terminating instance
Nov 08 18:39:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Instance destroyed successfully.
Nov 08 18:39:49 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'resources' on Instance uuid 490de0ea-289a-45aa-bb05-14fb138fb833 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914672766',display_name='tempest-AttachVolumeNegativeTest-server-1914672766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914672766',id=18,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqJRrMbTBhjYY5p23jr+qHP+TupoWKuJjf3TqixCjJjRRbAAZlAwPu0NODdSpBDTmiqRuo50SbNCG22aA4aeX2SgmKGKLJQ4tNLI5qkcPfyE89hINyGIQx9diaDGDbVw==',key_name='tempest-keypair-205483661',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:34:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-xq73rmpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=490de0ea-289a-45aa-bb05-14fb138fb833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "df8c6068-1bc4-4305-8774-c7f031143636", "address": "fa:16:3e:91:a7:04", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8c6068-1b", "ovs_interfaceid": "df8c6068-1bc4-4305-8774-c7f031143636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG os_vif [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf8c6068-1b, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f9ed569-25f6-4a00-a58b-9e257a916f61) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: INFO os_vif [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:a7:04,bridge_name='br-int',has_traffic_filtering=True,id=df8c6068-1bc4-4305-8774-c7f031143636,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8c6068-1b')
Nov 08 18:39:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Deleting instance files /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833_del
Nov 08 18:39:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Deletion of /opt/stack/data/nova/instances/490de0ea-289a-45aa-bb05-14fb138fb833_del complete
Nov 08 18:39:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:49 user nova-compute[74820]: INFO nova.compute.manager [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 08 18:39:49 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:39:49 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-vif-unplugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] No waiting events found dispatching network-vif-unplugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-vif-unplugged-df8c6068-1bc4-4305-8774-c7f031143636 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] Acquiring lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] Lock "490de0ea-289a-45aa-bb05-14fb138fb833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] No waiting events found dispatching network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:39:50 user nova-compute[74820]: WARNING nova.compute.manager [req-70208659-c18f-4d3c-a0ce-1336639d63a6 req-86d42115-2be5-447e-b752-3ec283321961 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received unexpected event network-vif-plugged-df8c6068-1bc4-4305-8774-c7f031143636 for instance with vm_state active and task_state deleting.
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-bad2f3ee-7718-4743-9b34-47f8296c7eef req-576d1003-640e-4b36-9a31-8f95eb050919 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bad2f3ee-7718-4743-9b34-47f8296c7eef req-576d1003-640e-4b36-9a31-8f95eb050919 service nova] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bad2f3ee-7718-4743-9b34-47f8296c7eef req-576d1003-640e-4b36-9a31-8f95eb050919 service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bad2f3ee-7718-4743-9b34-47f8296c7eef req-576d1003-640e-4b36-9a31-8f95eb050919 service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-bad2f3ee-7718-4743-9b34-47f8296c7eef req-576d1003-640e-4b36-9a31-8f95eb050919 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] No waiting events found dispatching network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:39:50 user nova-compute[74820]: WARNING nova.compute.manager [req-bad2f3ee-7718-4743-9b34-47f8296c7eef req-576d1003-640e-4b36-9a31-8f95eb050919 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received unexpected event network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab for instance with vm_state building and task_state spawning.
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:39:50 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Instance spawned successfully.
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:39:50 user nova-compute[74820]: INFO nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:39:50 user nova-compute[74820]: INFO nova.compute.manager [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Took 31.21 seconds to build instance.
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-018fb008-7b71-44e0-aaf8-83026dcefcf7 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.313s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:50 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:39:50 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Took 0.98 seconds to deallocate network for instance.
Nov 08 18:39:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:51 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:39:51 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:39:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:51 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Deleted allocations for instance 490de0ea-289a-45aa-bb05-14fb138fb833
Nov 08 18:39:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f1ce435-4012-4adc-a71f-ba7ec3011956 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "490de0ea-289a-45aa-bb05-14fb138fb833" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:51 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG nova.compute.manager [req-1ee47ecb-ecca-4940-8752-f5d27f9dfd95 req-ab13e9b9-02a2-4759-9d94-ae6220629550 service nova] [instance: 490de0ea-289a-45aa-bb05-14fb138fb833] Received event network-vif-deleted-df8c6068-1bc4-4305-8774-c7f031143636 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:39:58 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:39:58 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:39:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7063MB free_disk=25.04553985595703GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:39:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d4bbc087-e9df-431d-9c42-9e10718e7e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 11f4ce0b-0556-4a4f-8966-bc78e3ad6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2c0484b3-8be4-430f-9436-1f2f095414f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 021fc1ed-45b7-4473-b1a2-b59d2d928e2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 470bcaa6-f884-45ff-b3cb-08aae76c808a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:39:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:40:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:40:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:40:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [{"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-2c0484b3-8be4-430f-9436-1f2f095414f7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:40:01 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Creating image(s)
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Ensure instance console log exists: /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Start _get_guest_xml network_info=[{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '272f9a19-2029-4fda-825f-5b9bc446b460', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '470bcaa6-f884-45ff-b3cb-08aae76c808a', 'attached_at': '', 'detached_at': '', 'volume_id': '1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'serial': '1c7ddf10-b446-484a-afa8-0c51c2e664c3'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:40:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:40:01 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:40:01 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:40:01 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b988ad-ffb2-4fbe-985b-ae140cb13226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:40:01 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d0b29-ac22-424a-abd3-65d61540d953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3] added
Nov 08 18:40:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d280e8bb-8b9a-4039-8171-4ea7866920bd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09009b10-5c0d-4b3f-b581-42821db81ee1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYTgEnwk {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYTgEnwk" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7591a4-7015-4e7c-af98-9ad4c4083d88]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYTgEnwk'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f4c60-bd05-4a89-b384-bcca75efafbb]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[45926e11-636b-4065-b4c4-f80aaba00ee3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173ef49-f2de-4a21-83e3-41dc4982bf20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260]
Nov 08 18:40:01 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260] successful.
Nov 08 18:40:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89da4d-0dab-4107-9fe9-434f7e050ee0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f1b560-1bfc-42b6-bfd2-5ef703b21224]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:40:01 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:01 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a797e-c5db-46a6-a8e5-d506b5f7489c]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:01 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:40:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:40:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:40:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:40:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23865613733646461', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:40:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865613733646461', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1296681237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1296681237',id=30,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-6715oa04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:39:12Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=470bcaa6-f884-45ff-b3cb-08aae76c808a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'pci_devices' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:40:03 user nova-compute[74820]:   <uuid>470bcaa6-f884-45ff-b3cb-08aae76c808a</uuid>
Nov 08 18:40:03 user nova-compute[74820]:   <name>instance-0000001e</name>
Nov 08 18:40:03 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:40:03 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:40:03 user nova-compute[74820]:   <metadata>
Nov 08 18:40:03 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:40:03 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:40:03 user nova-compute[74820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1296681237</nova:name>
Nov 08 18:40:03 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:40:01</nova:creationTime>
Nov 08 18:40:03 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:40:03 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:40:03 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:40:03 user nova-compute[74820]:       <nova:owner>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:user uuid="c5790613f8a24f52897aedd0634f7f7f">tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member</nova:user>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:project uuid="e77a76c049904c6abe35b10929563c00">tempest-ServerBootFromVolumeStableRescueTest-516881030</nova:project>
Nov 08 18:40:03 user nova-compute[74820]:       </nova:owner>
Nov 08 18:40:03 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:40:03 user nova-compute[74820]:       <nova:ports>
Nov 08 18:40:03 user nova-compute[74820]:         <nova:port uuid="678c07b1-4c05-45b8-b2b8-b3aaff3d16ee">
Nov 08 18:40:03 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:40:03 user nova-compute[74820]:         </nova:port>
Nov 08 18:40:03 user nova-compute[74820]:       </nova:ports>
Nov 08 18:40:03 user nova-compute[74820]:     </nova:instance>
Nov 08 18:40:03 user nova-compute[74820]:   </metadata>
Nov 08 18:40:03 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:40:03 user nova-compute[74820]:     <system>
Nov 08 18:40:03 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:40:03 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:40:03 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:40:03 user nova-compute[74820]:       <entry name="serial">470bcaa6-f884-45ff-b3cb-08aae76c808a</entry>
Nov 08 18:40:03 user nova-compute[74820]:       <entry name="uuid">470bcaa6-f884-45ff-b3cb-08aae76c808a</entry>
Nov 08 18:40:03 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:40:03 user nova-compute[74820]:     </system>
Nov 08 18:40:03 user nova-compute[74820]:   </sysinfo>
Nov 08 18:40:03 user nova-compute[74820]:   <os>
Nov 08 18:40:03 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:40:03 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:40:03 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:40:03 user nova-compute[74820]:   </os>
Nov 08 18:40:03 user nova-compute[74820]:   <features>
Nov 08 18:40:03 user nova-compute[74820]:     <acpi/>
Nov 08 18:40:03 user nova-compute[74820]:     <apic/>
Nov 08 18:40:03 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:40:03 user nova-compute[74820]:   </features>
Nov 08 18:40:03 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:40:03 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:40:03 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:40:03 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:40:03 user nova-compute[74820]:   </clock>
Nov 08 18:40:03 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:40:03 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:40:03 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:40:03 user nova-compute[74820]:   </cpu>
Nov 08 18:40:03 user nova-compute[74820]:   <devices>
Nov 08 18:40:03 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:40:03 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:40:03 user nova-compute[74820]:       <source dev="/dev/sde"/>
Nov 08 18:40:03 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:40:03 user nova-compute[74820]:       <serial>1c7ddf10-b446-484a-afa8-0c51c2e664c3</serial>
Nov 08 18:40:03 user nova-compute[74820]:     </disk>
Nov 08 18:40:03 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:40:03 user nova-compute[74820]:       <mac address="fa:16:3e:aa:aa:e6"/>
Nov 08 18:40:03 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:40:03 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:40:03 user nova-compute[74820]:       <target dev="tap678c07b1-4c"/>
Nov 08 18:40:03 user nova-compute[74820]:     </interface>
Nov 08 18:40:03 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:40:03 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/console.log" append="off"/>
Nov 08 18:40:03 user nova-compute[74820]:     </serial>
Nov 08 18:40:03 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:40:03 user nova-compute[74820]:     <video>
Nov 08 18:40:03 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:40:03 user nova-compute[74820]:     </video>
Nov 08 18:40:03 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:40:03 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:40:03 user nova-compute[74820]:     </rng>
Nov 08 18:40:03 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:40:03 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:40:03 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:40:03 user nova-compute[74820]:     </memballoon>
Nov 08 18:40:03 user nova-compute[74820]:   </devices>
Nov 08 18:40:03 user nova-compute[74820]: </domain>
Nov 08 18:40:03 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1296681237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1296681237',id=30,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-6715oa04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:39:12Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=470bcaa6-f884-45ff-b3cb-08aae76c808a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG os_vif [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f049895c-b8e8-50de-a858-5e13fcf100a6', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap678c07b1-4c, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap678c07b1-4c, col_values=(('qos', UUID('e97bb764-0447-4c93-9fc0-cb63335c769a')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap678c07b1-4c, col_values=(('external_ids', {'iface-id': '678c07b1-4c05-45b8-b2b8-b3aaff3d16ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:aa:e6', 'vm-uuid': '470bcaa6-f884-45ff-b3cb-08aae76c808a'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:03 user nova-compute[74820]: INFO os_vif [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c')
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:40:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No VIF found with MAC fa:16:3e:aa:aa:e6, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-bb0a7259-5593-4dc3-97c4-3f94cd41efae req-6fab095e-25fd-4a64-8bfc-ef070e52edde service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bb0a7259-5593-4dc3-97c4-3f94cd41efae req-6fab095e-25fd-4a64-8bfc-ef070e52edde service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bb0a7259-5593-4dc3-97c4-3f94cd41efae req-6fab095e-25fd-4a64-8bfc-ef070e52edde service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-bb0a7259-5593-4dc3-97c4-3f94cd41efae req-6fab095e-25fd-4a64-8bfc-ef070e52edde service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-bb0a7259-5593-4dc3-97c4-3f94cd41efae req-6fab095e-25fd-4a64-8bfc-ef070e52edde service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:04 user nova-compute[74820]: WARNING nova.compute.manager [req-bb0a7259-5593-4dc3-97c4-3f94cd41efae req-6fab095e-25fd-4a64-8bfc-ef070e52edde service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state building and task_state spawning.
Nov 08 18:40:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:40:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance spawned successfully.
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-83ae65e9-95fa-4753-a901-d3efba0f9725 req-54bccb42-9ab3-4aa8-8133-6a36f9fe5d75 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83ae65e9-95fa-4753-a901-d3efba0f9725 req-54bccb42-9ab3-4aa8-8133-6a36f9fe5d75 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83ae65e9-95fa-4753-a901-d3efba0f9725 req-54bccb42-9ab3-4aa8-8133-6a36f9fe5d75 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83ae65e9-95fa-4753-a901-d3efba0f9725 req-54bccb42-9ab3-4aa8-8133-6a36f9fe5d75 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-83ae65e9-95fa-4753-a901-d3efba0f9725 req-54bccb42-9ab3-4aa8-8133-6a36f9fe5d75 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:06 user nova-compute[74820]: WARNING nova.compute.manager [req-83ae65e9-95fa-4753-a901-d3efba0f9725 req-54bccb42-9ab3-4aa8-8133-6a36f9fe5d75 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state building and task_state spawning.
Nov 08 18:40:06 user nova-compute[74820]: INFO nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 08 18:40:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:40:06 user nova-compute[74820]: INFO nova.compute.manager [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Took 55.79 seconds to build instance.
Nov 08 18:40:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9b357d0-b9d0-4b33-859a-0bbc80d936dd tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.211s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKPLTayM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:40:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:40:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:40:11 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc124fa-991a-42a4-8f11-c0f929f83ad6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:40:11 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e2b63-f6aa-4372-8ca7-e6419f5cc8b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4] added
Nov 08 18:40:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[043bc9e3-eea9-4b65-8fcd-c5987a28b98d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[86418750-da8e-4089-95d4-e6a4d269bee3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKPLTayM {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKPLTayM" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d198ed-4afb-4ff6-851f-11b15aef7518]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hKPLTayM'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae66566-cbac-4897-a364-e7b9e10d6a21]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[13611c65-0c0c-4540-af78-a5aa150f5442]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:11 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:11 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:40:11 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:11 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:11 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:40:11 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f191b7da-e3f7-46b0-807b-182d98e25103]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260]
Nov 08 18:40:11 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260] successful.
Nov 08 18:40:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e6b748-5836-4f24-baab-0e615a29cb22]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065ebff-70cb-4583-a946-67cb015dc1c0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)
Nov 08 18:40:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:40:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4f3ba-0e25-49bb-b13f-744f9a1a2849]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:40:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKPLTayM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23566343835636535', 'path': '/dev/sdf'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566343835636535', 'path': '/dev/sdf'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.objects.instance [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'flavor' on Instance uuid 94ab5fd7-d916-440a-8cfb-6a7572c242e3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:40:13 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:40:13 user nova-compute[74820]:   <source dev="/dev/sdf"/>
Nov 08 18:40:13 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:40:13 user nova-compute[74820]:   <serial>039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4</serial>
Nov 08 18:40:13 user nova-compute[74820]: </disk>
Nov 08 18:40:13 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] No VIF found with MAC fa:16:3e:3a:64:3d, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:40:13 user nova-compute[74820]: INFO nova.compute.manager [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Rescuing
Nov 08 18:40:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:40:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39588c6d-88ca-4ffe-9e9a-9b4378e65892 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.108s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-7582bc96-d66a-45aa-bd36-a87af1866f70 req-29d65da6-11e8-4912-a5cf-31b7c3e48d68 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-unplugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7582bc96-d66a-45aa-bd36-a87af1866f70 req-29d65da6-11e8-4912-a5cf-31b7c3e48d68 service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7582bc96-d66a-45aa-bd36-a87af1866f70 req-29d65da6-11e8-4912-a5cf-31b7c3e48d68 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7582bc96-d66a-45aa-bd36-a87af1866f70 req-29d65da6-11e8-4912-a5cf-31b7c3e48d68 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-7582bc96-d66a-45aa-bd36-a87af1866f70 req-29d65da6-11e8-4912-a5cf-31b7c3e48d68 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-unplugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:14 user nova-compute[74820]: WARNING nova.compute.manager [req-7582bc96-d66a-45aa-bd36-a87af1866f70 req-29d65da6-11e8-4912-a5cf-31b7c3e48d68 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-unplugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state active and task_state rescuing.
Nov 08 18:40:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance destroyed successfully.
Nov 08 18:40:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Attempting rescue
Nov 08 18:40:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:40:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Creating image(s)
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:14 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'trusted_certs' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue" returned: 0 in 0.051s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'migration_context' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.base [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<195fa78f-a73f-494e-b95b-41b5061326b2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Start _get_guest_xml network_info=[{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:17:b6:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'resources' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.base [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<195fa78f-a73f-494e-b95b-41b5061326b2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'numa_topology' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.base [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<195fa78f-a73f-494e-b95b-41b5061326b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:40:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'vcpu_model' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.base [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<195fa78f-a73f-494e-b95b-41b5061326b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-73105212',display_name='tempest-ServerRescueNegativeTestJSON-server-73105212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-73105212',id=27,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-icw14c7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:34Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=195fa78f-a73f-494e-b95b-41b5061326b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:17:b6:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:17:b6:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'pci_devices' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.objects.base [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<195fa78f-a73f-494e-b95b-41b5061326b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:40:15 user nova-compute[74820]:   <uuid>195fa78f-a73f-494e-b95b-41b5061326b2</uuid>
Nov 08 18:40:15 user nova-compute[74820]:   <name>instance-0000001b</name>
Nov 08 18:40:15 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:40:15 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:40:15 user nova-compute[74820]:   <metadata>
Nov 08 18:40:15 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:40:15 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:40:15 user nova-compute[74820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-73105212</nova:name>
Nov 08 18:40:15 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:40:15</nova:creationTime>
Nov 08 18:40:15 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:40:15 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:40:15 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:40:15 user nova-compute[74820]:       <nova:owner>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:user uuid="cb2804c2bc374d52a2283e78f03959c6">tempest-ServerRescueNegativeTestJSON-1619361117-project-member</nova:user>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:project uuid="622d25fd48684d82bb673a57cf0a7928">tempest-ServerRescueNegativeTestJSON-1619361117</nova:project>
Nov 08 18:40:15 user nova-compute[74820]:       </nova:owner>
Nov 08 18:40:15 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:40:15 user nova-compute[74820]:       <nova:ports>
Nov 08 18:40:15 user nova-compute[74820]:         <nova:port uuid="dffbecd7-0e8c-4bba-bb02-ac23604ded73">
Nov 08 18:40:15 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:40:15 user nova-compute[74820]:         </nova:port>
Nov 08 18:40:15 user nova-compute[74820]:       </nova:ports>
Nov 08 18:40:15 user nova-compute[74820]:     </nova:instance>
Nov 08 18:40:15 user nova-compute[74820]:   </metadata>
Nov 08 18:40:15 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:40:15 user nova-compute[74820]:     <system>
Nov 08 18:40:15 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:40:15 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:40:15 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:40:15 user nova-compute[74820]:       <entry name="serial">195fa78f-a73f-494e-b95b-41b5061326b2</entry>
Nov 08 18:40:15 user nova-compute[74820]:       <entry name="uuid">195fa78f-a73f-494e-b95b-41b5061326b2</entry>
Nov 08 18:40:15 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:40:15 user nova-compute[74820]:     </system>
Nov 08 18:40:15 user nova-compute[74820]:   </sysinfo>
Nov 08 18:40:15 user nova-compute[74820]:   <os>
Nov 08 18:40:15 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:40:15 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:40:15 user nova-compute[74820]:   </os>
Nov 08 18:40:15 user nova-compute[74820]:   <features>
Nov 08 18:40:15 user nova-compute[74820]:     <acpi/>
Nov 08 18:40:15 user nova-compute[74820]:     <apic/>
Nov 08 18:40:15 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:40:15 user nova-compute[74820]:   </features>
Nov 08 18:40:15 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:40:15 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:40:15 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:40:15 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:40:15 user nova-compute[74820]:   </clock>
Nov 08 18:40:15 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:40:15 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:40:15 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:40:15 user nova-compute[74820]:   </cpu>
Nov 08 18:40:15 user nova-compute[74820]:   <devices>
Nov 08 18:40:15 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:40:15 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:40:15 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue"/>
Nov 08 18:40:15 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:40:15 user nova-compute[74820]:     </disk>
Nov 08 18:40:15 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:40:15 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:40:15 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk"/>
Nov 08 18:40:15 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:40:15 user nova-compute[74820]:     </disk>
Nov 08 18:40:15 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:40:15 user nova-compute[74820]:       <mac address="fa:16:3e:17:b6:1d"/>
Nov 08 18:40:15 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:40:15 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:40:15 user nova-compute[74820]:       <target dev="tapdffbecd7-0e"/>
Nov 08 18:40:15 user nova-compute[74820]:     </interface>
Nov 08 18:40:15 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:40:15 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/console.log" append="off"/>
Nov 08 18:40:15 user nova-compute[74820]:     </serial>
Nov 08 18:40:15 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:40:15 user nova-compute[74820]:     <video>
Nov 08 18:40:15 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:40:15 user nova-compute[74820]:     </video>
Nov 08 18:40:15 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:40:15 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:40:15 user nova-compute[74820]:     </rng>
Nov 08 18:40:15 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:40:15 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:40:15 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:40:15 user nova-compute[74820]:     </memballoon>
Nov 08 18:40:15 user nova-compute[74820]:   </devices>
Nov 08 18:40:15 user nova-compute[74820]: </domain>
Nov 08 18:40:15 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:40:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance destroyed successfully.
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:40:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:17:b6:1d, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-642858dc-e2e6-42f5-9e2d-5cf41a465d47 req-57453c7f-c15a-4148-9f13-0782f72c2df7 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-642858dc-e2e6-42f5-9e2d-5cf41a465d47 req-57453c7f-c15a-4148-9f13-0782f72c2df7 service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-642858dc-e2e6-42f5-9e2d-5cf41a465d47 req-57453c7f-c15a-4148-9f13-0782f72c2df7 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-642858dc-e2e6-42f5-9e2d-5cf41a465d47 req-57453c7f-c15a-4148-9f13-0782f72c2df7 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-642858dc-e2e6-42f5-9e2d-5cf41a465d47 req-57453c7f-c15a-4148-9f13-0782f72c2df7 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:16 user nova-compute[74820]: WARNING nova.compute.manager [req-642858dc-e2e6-42f5-9e2d-5cf41a465d47 req-57453c7f-c15a-4148-9f13-0782f72c2df7 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state active and task_state rescuing.
Nov 08 18:40:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:18 user nova-compute[74820]: WARNING nova.compute.manager [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state active and task_state rescuing.
Nov 08 18:40:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:18 user nova-compute[74820]: WARNING nova.compute.manager [req-a7d89803-9244-4b28-b3d9-19460bc6bb9f req-03d59e98-ac8e-4f30-b272-ee5fa53a4380 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state active and task_state rescuing.
Nov 08 18:40:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ab2342f5-7fcc-4ef7-a018-d62bcd17de6b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:22 user nova-compute[74820]: INFO nova.compute.manager [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Terminating instance
Nov 08 18:40:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-c3611681-1b65-4c3f-8ecf-9409cf0958b0 req-45d7eeaa-41fd-4225-9879-78673c9471c1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-unplugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c3611681-1b65-4c3f-8ecf-9409cf0958b0 req-45d7eeaa-41fd-4225-9879-78673c9471c1 service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c3611681-1b65-4c3f-8ecf-9409cf0958b0 req-45d7eeaa-41fd-4225-9879-78673c9471c1 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c3611681-1b65-4c3f-8ecf-9409cf0958b0 req-45d7eeaa-41fd-4225-9879-78673c9471c1 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-c3611681-1b65-4c3f-8ecf-9409cf0958b0 req-45d7eeaa-41fd-4225-9879-78673c9471c1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-unplugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-c3611681-1b65-4c3f-8ecf-9409cf0958b0 req-45d7eeaa-41fd-4225-9879-78673c9471c1 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-unplugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Instance destroyed successfully.
Nov 08 18:40:23 user nova-compute[74820]: DEBUG nova.objects.instance [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lazy-loading 'resources' on Instance uuid 2c0484b3-8be4-430f-9436-1f2f095414f7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:34:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-672706708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-672706708',id=19,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeLu4U4L/nu4w3Uc7Um1BOuM1F3kA/OXwZyWRqqh9o3mYLxOrgGDWs85OnJTRDpbbjY/NhHJY6FDRaCDLZDsO/TmP3WWpBN6cTir9wTkID2/xs8OZJgEvde2BURzWe0UA==',key_name='tempest-keypair-1190867603',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c3b99ebc044d32a5647dc7963f11ae',ramdisk_id='',reservation_id='r-mkchcuj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1684933452',owner_user_name='tempest-AttachVolumeShelveTestJSON-1684933452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adeab5384fc4d8fad36575d715cf133',uuid=2c0484b3-8be4-430f-9436-1f2f095414f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converting VIF {"id": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "address": "fa:16:3e:87:bc:ee", "network": {"id": "1a0ca251-0fa7-48be-af39-20ad371eed68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1115624231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c3b99ebc044d32a5647dc7963f11ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784a7f5c-9e", "ovs_interfaceid": "784a7f5c-9e81-4ae6-a2ff-d687f6cab22d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG os_vif [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap784a7f5c-9e, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=717bfb6c-f25f-4655-aeaa-902e6eed1df1) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:23 user nova-compute[74820]: INFO os_vif [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:bc:ee,bridge_name='br-int',has_traffic_filtering=True,id=784a7f5c-9e81-4ae6-a2ff-d687f6cab22d,network=Network(1a0ca251-0fa7-48be-af39-20ad371eed68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784a7f5c-9e')
Nov 08 18:40:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Deleting instance files /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7_del
Nov 08 18:40:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Deletion of /opt/stack/data/nova/instances/2c0484b3-8be4-430f-9436-1f2f095414f7_del complete
Nov 08 18:40:23 user nova-compute[74820]: INFO nova.compute.manager [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 18:40:23 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:40:23 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:24 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Took 1.21 seconds to deallocate network for instance.
Nov 08 18:40:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-1b981c70-f36a-4e20-88c5-7ddacd61d5f2 req-8b9a3028-10ef-4976-86b7-860408fbeb3c service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-deleted-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-7e104f63-936f-4a30-ab40-e3dbc71e90bb req-debfca83-1add-493d-b757-c172088e6632 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7e104f63-936f-4a30-ab40-e3dbc71e90bb req-debfca83-1add-493d-b757-c172088e6632 service nova] Acquiring lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7e104f63-936f-4a30-ab40-e3dbc71e90bb req-debfca83-1add-493d-b757-c172088e6632 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7e104f63-936f-4a30-ab40-e3dbc71e90bb req-debfca83-1add-493d-b757-c172088e6632 service nova] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-7e104f63-936f-4a30-ab40-e3dbc71e90bb req-debfca83-1add-493d-b757-c172088e6632 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] No waiting events found dispatching network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:24 user nova-compute[74820]: WARNING nova.compute.manager [req-7e104f63-936f-4a30-ab40-e3dbc71e90bb req-debfca83-1add-493d-b757-c172088e6632 service nova] [instance: 2c0484b3-8be4-430f-9436-1f2f095414f7] Received unexpected event network-vif-plugged-784a7f5c-9e81-4ae6-a2ff-d687f6cab22d for instance with vm_state deleted and task_state None.
Nov 08 18:40:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:40:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:40:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:25 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Deleted allocations for instance 2c0484b3-8be4-430f-9436-1f2f095414f7
Nov 08 18:40:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-18693bae-dffd-44e9-9193-2990541c3e32 tempest-AttachVolumeShelveTestJSON-1684933452 tempest-AttachVolumeShelveTestJSON-1684933452-project-member] Lock "2c0484b3-8be4-430f-9436-1f2f095414f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.962s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:32 user nova-compute[74820]: INFO nova.compute.manager [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Terminating instance
Nov 08 18:40:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-2e495dac-53b9-40c2-81cc-e3dc36192825 req-d2b63cdd-716b-48a9-a471-a5d17c795ba1 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-vif-unplugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2e495dac-53b9-40c2-81cc-e3dc36192825 req-d2b63cdd-716b-48a9-a471-a5d17c795ba1 service nova] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2e495dac-53b9-40c2-81cc-e3dc36192825 req-d2b63cdd-716b-48a9-a471-a5d17c795ba1 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2e495dac-53b9-40c2-81cc-e3dc36192825 req-d2b63cdd-716b-48a9-a471-a5d17c795ba1 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-2e495dac-53b9-40c2-81cc-e3dc36192825 req-d2b63cdd-716b-48a9-a471-a5d17c795ba1 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] No waiting events found dispatching network-vif-unplugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-2e495dac-53b9-40c2-81cc-e3dc36192825 req-d2b63cdd-716b-48a9-a471-a5d17c795ba1 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-vif-unplugged-68d7a840-c915-491a-859e-52a69c90abae for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:40:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Instance destroyed successfully.
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lazy-loading 'resources' on Instance uuid 021fc1ed-45b7-4473-b1a2-b59d2d928e2f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-594433347',display_name='tempest-VolumesActionsTest-instance-594433347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-594433347',id=29,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05ea7b7c3bcf4b469efa9d092e0a54f6',ramdisk_id='',reservation_id='r-fe7u0l4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1331237735',owner_user_name='tempest-VolumesActionsTest-1331237735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:38:50Z,user_data=None,user_id='67910c8b82124239a88bd5d1153e6365',uuid=021fc1ed-45b7-4473-b1a2-b59d2d928e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converting VIF {"id": "68d7a840-c915-491a-859e-52a69c90abae", "address": "fa:16:3e:75:f9:87", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d7a840-c9", "ovs_interfaceid": "68d7a840-c915-491a-859e-52a69c90abae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG os_vif [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68d7a840-c9, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98468ee0-d4fe-4413-9ad1-86244f55f118) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:33 user nova-compute[74820]: INFO os_vif [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=68d7a840-c915-491a-859e-52a69c90abae,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d7a840-c9')
Nov 08 18:40:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Deleting instance files /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f_del
Nov 08 18:40:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Deletion of /opt/stack/data/nova/instances/021fc1ed-45b7-4473-b1a2-b59d2d928e2f_del complete
Nov 08 18:40:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:33 user nova-compute[74820]: INFO nova.compute.manager [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 18:40:33 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:33 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Took 0.58 seconds to deallocate network for instance.
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-6c116700-3187-4c5e-a45e-1181e775873d req-385b70cc-a7f1-43a8-9560-00838e52f4b2 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-vif-deleted-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:33 user nova-compute[74820]: INFO nova.compute.manager [req-6c116700-3187-4c5e-a45e-1181e775873d req-385b70cc-a7f1-43a8-9560-00838e52f4b2 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Neutron deleted interface 68d7a840-c915-491a-859e-52a69c90abae; detaching it from the instance and deleting it from the info cache
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.network.neutron [req-6c116700-3187-4c5e-a45e-1181e775873d req-385b70cc-a7f1-43a8-9560-00838e52f4b2 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-6c116700-3187-4c5e-a45e-1181e775873d req-385b70cc-a7f1-43a8-9560-00838e52f4b2 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Detach interface failed, port_id=68d7a840-c915-491a-859e-52a69c90abae, reason: Instance 021fc1ed-45b7-4473-b1a2-b59d2d928e2f could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:34 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Deleted allocations for instance 021fc1ed-45b7-4473-b1a2-b59d2d928e2f
Nov 08 18:40:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-78082eee-b485-40b8-a1ee-9ed12908f26b tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-40703a94-a174-4493-927b-7a918a3585f5 req-b851a50c-8c3a-4ab0-bf38-753f74fe90b8 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received event network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40703a94-a174-4493-927b-7a918a3585f5 req-b851a50c-8c3a-4ab0-bf38-753f74fe90b8 service nova] Acquiring lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40703a94-a174-4493-927b-7a918a3585f5 req-b851a50c-8c3a-4ab0-bf38-753f74fe90b8 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40703a94-a174-4493-927b-7a918a3585f5 req-b851a50c-8c3a-4ab0-bf38-753f74fe90b8 service nova] Lock "021fc1ed-45b7-4473-b1a2-b59d2d928e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-40703a94-a174-4493-927b-7a918a3585f5 req-b851a50c-8c3a-4ab0-bf38-753f74fe90b8 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] No waiting events found dispatching network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:34 user nova-compute[74820]: WARNING nova.compute.manager [req-40703a94-a174-4493-927b-7a918a3585f5 req-b851a50c-8c3a-4ab0-bf38-753f74fe90b8 service nova] [instance: 021fc1ed-45b7-4473-b1a2-b59d2d928e2f] Received unexpected event network-vif-plugged-68d7a840-c915-491a-859e-52a69c90abae for instance with vm_state deleted and task_state None.
Nov 08 18:40:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:35 user nova-compute[74820]: INFO nova.compute.manager [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Terminating instance
Nov 08 18:40:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-4720cdd5-7684-4ed0-89bf-8c1366203e49 req-f4c33cdc-cf3d-4ea2-805a-8ec17ae555f2 service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-vif-unplugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4720cdd5-7684-4ed0-89bf-8c1366203e49 req-f4c33cdc-cf3d-4ea2-805a-8ec17ae555f2 service nova] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4720cdd5-7684-4ed0-89bf-8c1366203e49 req-f4c33cdc-cf3d-4ea2-805a-8ec17ae555f2 service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4720cdd5-7684-4ed0-89bf-8c1366203e49 req-f4c33cdc-cf3d-4ea2-805a-8ec17ae555f2 service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-4720cdd5-7684-4ed0-89bf-8c1366203e49 req-f4c33cdc-cf3d-4ea2-805a-8ec17ae555f2 service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] No waiting events found dispatching network-vif-unplugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-4720cdd5-7684-4ed0-89bf-8c1366203e49 req-f4c33cdc-cf3d-4ea2-805a-8ec17ae555f2 service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-vif-unplugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Instance destroyed successfully.
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.objects.instance [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'resources' on Instance uuid 11f4ce0b-0556-4a4f-8966-bc78e3ad6313 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2083992474',display_name='tempest-VolumesAdminNegativeTest-server-2083992474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2083992474',id=28,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='008fbbc99e0b4aca939d6338fdd7fa82',ramdisk_id='',reservation_id='r-62a8tw5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-571307425',owner_user_name='tempest-VolumesAdminNegativeTest-571307425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:38:35Z,user_data=None,user_id='3c84ad1439444413bc8a2acfffff1f2b',uuid=11f4ce0b-0556-4a4f-8966-bc78e3ad6313,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converting VIF {"id": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "address": "fa:16:3e:d4:77:e1", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a6d63d-b7", "ovs_interfaceid": "81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG os_vif [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81a6d63d-b7, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d30e3ac-b292-4dcd-bb71-352c08e579b2) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:36 user nova-compute[74820]: INFO os_vif [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:77:e1,bridge_name='br-int',has_traffic_filtering=True,id=81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a6d63d-b7')
Nov 08 18:40:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Deleting instance files /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313_del
Nov 08 18:40:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Deletion of /opt/stack/data/nova/instances/11f4ce0b-0556-4a4f-8966-bc78e3ad6313_del complete
Nov 08 18:40:36 user nova-compute[74820]: INFO nova.compute.manager [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 18:40:36 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:40:36 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:40:37 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:37 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Took 0.51 seconds to deallocate network for instance.
Nov 08 18:40:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-d739484c-d796-4a64-8f91-f4bf8682b58e req-dff6c9e6-6ba0-42a1-9d08-004ed17561c3 service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-vif-deleted-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:37 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:40:37 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:40:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:37 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Deleted allocations for instance 11f4ce0b-0556-4a4f-8966-bc78e3ad6313
Nov 08 18:40:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-56a06285-f272-4a24-9536-1f560b8fa51b tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-897adca6-cf34-4832-bf88-4776fea3de98 req-78b3d70c-4747-4efa-8dbc-f07dbc33d5fa service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received event network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-897adca6-cf34-4832-bf88-4776fea3de98 req-78b3d70c-4747-4efa-8dbc-f07dbc33d5fa service nova] Acquiring lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-897adca6-cf34-4832-bf88-4776fea3de98 req-78b3d70c-4747-4efa-8dbc-f07dbc33d5fa service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-897adca6-cf34-4832-bf88-4776fea3de98 req-78b3d70c-4747-4efa-8dbc-f07dbc33d5fa service nova] Lock "11f4ce0b-0556-4a4f-8966-bc78e3ad6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-897adca6-cf34-4832-bf88-4776fea3de98 req-78b3d70c-4747-4efa-8dbc-f07dbc33d5fa service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] No waiting events found dispatching network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:38 user nova-compute[74820]: WARNING nova.compute.manager [req-897adca6-cf34-4832-bf88-4776fea3de98 req-78b3d70c-4747-4efa-8dbc-f07dbc33d5fa service nova] [instance: 11f4ce0b-0556-4a4f-8966-bc78e3ad6313] Received unexpected event network-vif-plugged-81a6d63d-b7d7-4b4b-8e95-cf7cc9bff98b for instance with vm_state deleted and task_state None.
Nov 08 18:40:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:40:43 user nova-compute[74820]: INFO nova.compute.claims [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Claim successful on node user
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:40:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.policy [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecfee2b968614f47aa97aafd07b66548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f45aa33327417986332546abed6d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:40:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Creating image(s)
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "/opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.033s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk 1073741824" returned: 0 in 0.060s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Successfully created port: 5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.224s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Cannot resize image /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Ensure instance console log exists: /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Successfully updated port: 5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquired lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-changed-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Refreshing instance network info cache due to event network-changed-5af42030-70b7-4c1d-a37e-96f61319a9c8. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] Acquiring lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updating instance_info_cache with network_info: [{"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Releasing lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Instance network_info: |[{"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] Acquired lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Refreshing network info cache for port 5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Start _get_guest_xml network_info=[{"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:40:46 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:46 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1736974812',display_name='tempest-AttachVolumeNegativeTest-server-1736974812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1736974812',id=33,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK62dwNWdlDCbC+X+/XvzpKzJaMtgyjaaOfqTQCj7+dRAara903+hn8Ta8lenRYI2AWgT5DpxQmPLcmzliePtMyBJzwcZFZZ0OCPGQu0LM3GJNwV2XwgBO48eouW5zhRkw==',key_name='tempest-keypair-1220992648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-xdehzq1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=f3ae0593-3d03-4b93-b444-6d5c4ef414c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'pci_devices' on Instance uuid f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:40:46 user nova-compute[74820]:   <uuid>f3ae0593-3d03-4b93-b444-6d5c4ef414c3</uuid>
Nov 08 18:40:46 user nova-compute[74820]:   <name>instance-00000021</name>
Nov 08 18:40:46 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:40:46 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:40:46 user nova-compute[74820]:   <metadata>
Nov 08 18:40:46 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:40:46 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:40:46 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1736974812</nova:name>
Nov 08 18:40:46 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:40:46</nova:creationTime>
Nov 08 18:40:46 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:40:46 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:40:46 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:40:46 user nova-compute[74820]:       <nova:owner>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:user uuid="ecfee2b968614f47aa97aafd07b66548">tempest-AttachVolumeNegativeTest-657533753-project-member</nova:user>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:project uuid="d4f45aa33327417986332546abed6d92">tempest-AttachVolumeNegativeTest-657533753</nova:project>
Nov 08 18:40:46 user nova-compute[74820]:       </nova:owner>
Nov 08 18:40:46 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:40:46 user nova-compute[74820]:       <nova:ports>
Nov 08 18:40:46 user nova-compute[74820]:         <nova:port uuid="5af42030-70b7-4c1d-a37e-96f61319a9c8">
Nov 08 18:40:46 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 18:40:46 user nova-compute[74820]:         </nova:port>
Nov 08 18:40:46 user nova-compute[74820]:       </nova:ports>
Nov 08 18:40:46 user nova-compute[74820]:     </nova:instance>
Nov 08 18:40:46 user nova-compute[74820]:   </metadata>
Nov 08 18:40:46 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:40:46 user nova-compute[74820]:     <system>
Nov 08 18:40:46 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:40:46 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:40:46 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:40:46 user nova-compute[74820]:       <entry name="serial">f3ae0593-3d03-4b93-b444-6d5c4ef414c3</entry>
Nov 08 18:40:46 user nova-compute[74820]:       <entry name="uuid">f3ae0593-3d03-4b93-b444-6d5c4ef414c3</entry>
Nov 08 18:40:46 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:40:46 user nova-compute[74820]:     </system>
Nov 08 18:40:46 user nova-compute[74820]:   </sysinfo>
Nov 08 18:40:46 user nova-compute[74820]:   <os>
Nov 08 18:40:46 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:40:46 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:40:46 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:40:46 user nova-compute[74820]:   </os>
Nov 08 18:40:46 user nova-compute[74820]:   <features>
Nov 08 18:40:46 user nova-compute[74820]:     <acpi/>
Nov 08 18:40:46 user nova-compute[74820]:     <apic/>
Nov 08 18:40:46 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:40:46 user nova-compute[74820]:   </features>
Nov 08 18:40:46 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:40:46 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:40:46 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:40:46 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:40:46 user nova-compute[74820]:   </clock>
Nov 08 18:40:46 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:40:46 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:40:46 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:40:46 user nova-compute[74820]:   </cpu>
Nov 08 18:40:46 user nova-compute[74820]:   <devices>
Nov 08 18:40:46 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:40:46 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:40:46 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk"/>
Nov 08 18:40:46 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:40:46 user nova-compute[74820]:     </disk>
Nov 08 18:40:46 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:40:46 user nova-compute[74820]:       <mac address="fa:16:3e:13:06:66"/>
Nov 08 18:40:46 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:40:46 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:40:46 user nova-compute[74820]:       <target dev="tap5af42030-70"/>
Nov 08 18:40:46 user nova-compute[74820]:     </interface>
Nov 08 18:40:46 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:40:46 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/console.log" append="off"/>
Nov 08 18:40:46 user nova-compute[74820]:     </serial>
Nov 08 18:40:46 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:40:46 user nova-compute[74820]:     <video>
Nov 08 18:40:46 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:40:46 user nova-compute[74820]:     </video>
Nov 08 18:40:46 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:40:46 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:40:46 user nova-compute[74820]:     </rng>
Nov 08 18:40:46 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:40:46 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:40:46 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:40:46 user nova-compute[74820]:     </memballoon>
Nov 08 18:40:46 user nova-compute[74820]:   </devices>
Nov 08 18:40:46 user nova-compute[74820]: </domain>
Nov 08 18:40:46 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1736974812',display_name='tempest-AttachVolumeNegativeTest-server-1736974812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1736974812',id=33,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK62dwNWdlDCbC+X+/XvzpKzJaMtgyjaaOfqTQCj7+dRAara903+hn8Ta8lenRYI2AWgT5DpxQmPLcmzliePtMyBJzwcZFZZ0OCPGQu0LM3GJNwV2XwgBO48eouW5zhRkw==',key_name='tempest-keypair-1220992648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-xdehzq1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=f3ae0593-3d03-4b93-b444-6d5c4ef414c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG os_vif [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75eaa699-e732-5b0c-a55c-f28e3c3920eb', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5af42030-70, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5af42030-70, col_values=(('qos', UUID('e223329b-8770-4f01-81fd-c2c24c7b1f0f')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5af42030-70, col_values=(('external_ids', {'iface-id': '5af42030-70b7-4c1d-a37e-96f61319a9c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:06:66', 'vm-uuid': 'f3ae0593-3d03-4b93-b444-6d5c4ef414c3'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:46 user nova-compute[74820]: INFO os_vif [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70')
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No VIF found with MAC fa:16:3e:13:06:66, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updated VIF entry in instance network info cache for port 5af42030-70b7-4c1d-a37e-96f61319a9c8. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG nova.network.neutron [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updating instance_info_cache with network_info: [{"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:40:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7b9dab9c-b601-4861-b89f-3359cd7d7198 req-7231bbe4-f0e3-42c1-b2ff-0d4676ece973 service nova] Releasing lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:40:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-fd669078-08e0-4f5b-a2bb-5465e1a75730 req-3f13c9aa-0a89-44ca-ac75-54a922209dfc service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fd669078-08e0-4f5b-a2bb-5465e1a75730 req-3f13c9aa-0a89-44ca-ac75-54a922209dfc service nova] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fd669078-08e0-4f5b-a2bb-5465e1a75730 req-3f13c9aa-0a89-44ca-ac75-54a922209dfc service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fd669078-08e0-4f5b-a2bb-5465e1a75730 req-3f13c9aa-0a89-44ca-ac75-54a922209dfc service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-fd669078-08e0-4f5b-a2bb-5465e1a75730 req-3f13c9aa-0a89-44ca-ac75-54a922209dfc service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] No waiting events found dispatching network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:48 user nova-compute[74820]: WARNING nova.compute.manager [req-fd669078-08e0-4f5b-a2bb-5465e1a75730 req-3f13c9aa-0a89-44ca-ac75-54a922209dfc service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received unexpected event network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 for instance with vm_state building and task_state spawning.
Nov 08 18:40:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:40:50 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Instance spawned successfully.
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:40:50 user nova-compute[74820]: INFO nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-1572a4a3-aba5-4a78-8171-f8cd105930c8 req-162cc0c7-0bb0-4d73-80f8-0f564e9c4684 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1572a4a3-aba5-4a78-8171-f8cd105930c8 req-162cc0c7-0bb0-4d73-80f8-0f564e9c4684 service nova] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1572a4a3-aba5-4a78-8171-f8cd105930c8 req-162cc0c7-0bb0-4d73-80f8-0f564e9c4684 service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1572a4a3-aba5-4a78-8171-f8cd105930c8 req-162cc0c7-0bb0-4d73-80f8-0f564e9c4684 service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-1572a4a3-aba5-4a78-8171-f8cd105930c8 req-162cc0c7-0bb0-4d73-80f8-0f564e9c4684 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] No waiting events found dispatching network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:40:50 user nova-compute[74820]: WARNING nova.compute.manager [req-1572a4a3-aba5-4a78-8171-f8cd105930c8 req-162cc0c7-0bb0-4d73-80f8-0f564e9c4684 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received unexpected event network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 for instance with vm_state building and task_state spawning.
Nov 08 18:40:50 user nova-compute[74820]: INFO nova.compute.manager [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Took 6.41 seconds to build instance.
Nov 08 18:40:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a037c02b-d6c2-4387-a209-e0908232578c tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.771s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:51 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:52 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:40:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:40:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:40:58 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:58 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7144MB free_disk=25.11467742919922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d4bbc087-e9df-431d-9c42-9e10718e7e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 470bcaa6-f884-45ff-b3cb-08aae76c808a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:40:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:40:59 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [{"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-3cbcbe67-7c9c-46a8-8617-85921d7fb83f" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:41:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-changed-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Refreshing instance network info cache due to event network-changed-5d03043b-6d05-4b75-beb0-4d59d95aeb6b. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Refreshing network info cache for port 5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updated VIF entry in instance network info cache for port 5d03043b-6d05-4b75-beb0-4d59d95aeb6b. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7c75d56d-9b7a-4a9f-8fb4-e1ed1703219a req-7d1bce6c-89f0-41d5-b38f-a255d15ad7dd service nova] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Stashing vm_state: active {{(pid=74820) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 18:41:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:09 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:41:09 user nova-compute[74820]: INFO nova.compute.claims [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Claim successful on node user
Nov 08 18:41:09 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating resource usage from migration 091fea2f-841c-4961-baa6-fb72781a4577
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-changed-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Refreshing instance network info cache due to event network-changed-9695cc5e-3d41-4296-80f2-1b5dbfd7192a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] Acquiring lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] Acquired lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Refreshing network info cache for port 9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.536s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:10 user nova-compute[74820]: INFO nova.compute.manager [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Migrating
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updated VIF entry in instance network info cache for port 9695cc5e-3d41-4296-80f2-1b5dbfd7192a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-edd54791-b7cc-4611-95b3-16898683bc1f req-ff27f79c-1be4-46e3-a1a5-8620b378f159 service nova] Releasing lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquired lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-changed-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Refreshing instance network info cache due to event network-changed-0f4ed3b8-25d2-47be-ba55-a7183934daab. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] Acquiring lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] Acquired lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Refreshing network info cache for port 0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Releasing lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Starting migrate_disk_and_power_off {{(pid=74820) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updated VIF entry in instance network info cache for port 0f4ed3b8-25d2-47be-ba55-a7183934daab. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updating instance_info_cache with network_info: [{"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-690b602a-8dd2-4a6e-b090-833017507c85 req-e60b55cb-ba3f-4bad-b1e5-d690f7e4e5a1 service nova] Releasing lock "refresh_cache-c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance destroyed successfully.
Nov 08 18:41:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-506693465',display_name='tempest-ServerActionsTestOtherA-server-506693465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-506693465',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-yehjp0wz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=86e06d0a-11c1-4e80-8592-b71f37124e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9695cc5e-3d, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c77fd186-3782-4e7b-a2aa-3e55e883305e) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:12 user nova-compute[74820]: INFO os_vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d')
Nov 08 18:41:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:12 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789c9e6-a9ee-4f82-8d10-e826690942ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:41:12 user nova-compute[74820]: No targets found.
Nov 08 18:41:12 user nova-compute[74820]: iSNS:
Nov 08 18:41:12 user nova-compute[74820]: No targets found.
Nov 08 18:41:12 user nova-compute[74820]: STATIC:
Nov 08 18:41:12 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802
Nov 08 18:41:12 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:12 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:12 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4
Nov 08 18:41:12 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:12 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:12 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:41:12 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:12 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:12 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8
Nov 08 18:41:12 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:12 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:12 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:41:12 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:12 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:12 user nova-compute[74820]: FIRMWARE:
Nov 08 18:41:12 user nova-compute[74820]: No targets found.
Nov 08 18:41:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:41:12 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:41:12 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[26849b79-eded-47f6-83e1-a9fda1089907]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1415ee1e-372e-4ab1-9831-f437ba087c88]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)
Nov 08 18:41:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e287eb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2715a2-128b-4ef8-bbda-d2b54e2cbe34]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79a664-1fc5-4662-9dc8-a370646f5ca2]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef31274-b860-4ef4-8536-33287b4e210d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a786bc5d-1d84-4229-97ec-67b0d0fab672]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1fd73042-498e6dfac2374fab', '/dev/disk/by-id/scsi-23439386536646661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1fd73042') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df9f39f-c587-4c2c-9197-ae3b35b2236d]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed85d453-bbae-4389-bc64-40010ad17add]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cde32e-5ff2-494b-93d6-5770e1d544df]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]
Nov 08 18:41:12 user nova-compute[74820]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.
Nov 08 18:41:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b250b8-d273-4237-8659-9d569474820b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== disconnect_volume: return (360ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:41:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-unplugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-unplugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:13 user nova-compute[74820]: WARNING nova.compute.manager [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-unplugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state active and task_state resize_migrating.
Nov 08 18:41:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:13 user nova-compute[74820]: WARNING nova.compute.manager [req-f1b7004a-a4ff-4442-8688-e30814f6af39 req-a99cc1fc-c530-44b7-817c-8ff979f7fe7c service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state active and task_state resize_migrating.
Nov 08 18:41:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Port 9695cc5e-3d41-4296-80f2-1b5dbfd7192a binding to destination host user is already ACTIVE {{(pid=74820) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquired lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Releasing lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG os_brick.utils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1e55c-fb4e-42d7-974f-61ebecb83518]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a1521-fd2c-4b12-91e4-3034dbdb8d0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[33839797-d526-40e2-8290-4b39b07ec540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a132392a-483c-4c1b-b52d-7527045d13fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:41:15 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:41:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd7943b-12ae-4d84-a37b-d9ca746b364d]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:41:15 user nova-compute[74820]: DEBUG os_brick.utils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:16 user nova-compute[74820]: INFO nova.compute.manager [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Detaching volume 039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4
Nov 08 18:41:16 user nova-compute[74820]: INFO nova.virt.block_device [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Attempting to driver detach volume 039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 from mountpoint /dev/vdb
Nov 08 18:41:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Attempting to detach device vdb from instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:41:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:41:16 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:41:16 user nova-compute[74820]:   <source dev="/dev/sdf"/>
Nov 08 18:41:16 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:41:16 user nova-compute[74820]:   <serial>039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4</serial>
Nov 08 18:41:16 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:41:16 user nova-compute[74820]: </disk>
Nov 08 18:41:16 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:41:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:16 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully detached device vdb from instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 from the persistent domain config.
Nov 08 18:41:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:41:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:41:16 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:41:16 user nova-compute[74820]:   <source dev="/dev/sdf"/>
Nov 08 18:41:16 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:41:16 user nova-compute[74820]:   <serial>039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4</serial>
Nov 08 18:41:16 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:41:16 user nova-compute[74820]: </disk>
Nov 08 18:41:16 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:41:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:41:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "83129ca8-015c-4007-8840-b930bfce06e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:41:24 user nova-compute[74820]: INFO nova.compute.claims [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Claim successful on node user
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:41:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.policy [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67910c8b82124239a88bd5d1153e6365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ea7b7c3bcf4b469efa9d092e0a54f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:41:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Creating image(s)
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "/opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "/opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "/opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk 1073741824" returned: 0 in 0.077s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Cannot resize image /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Ensure instance console log exists: /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Successfully created port: 065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Successfully updated port: 065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "refresh_cache-83129ca8-015c-4007-8840-b930bfce06e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquired lock "refresh_cache-83129ca8-015c-4007-8840-b930bfce06e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-changed-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Refreshing instance network info cache due to event network-changed-065ff51d-27de-49f0-a0e4-ab470961b485. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] Acquiring lock "refresh_cache-83129ca8-015c-4007-8840-b930bfce06e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:41:27 user nova-compute[74820]: INFO nova.compute.claims [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Claim successful on node user
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Updating instance_info_cache with network_info: [{"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Releasing lock "refresh_cache-83129ca8-015c-4007-8840-b930bfce06e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Instance network_info: |[{"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] Acquired lock "refresh_cache-83129ca8-015c-4007-8840-b930bfce06e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Refreshing network info cache for port 065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Start _get_guest_xml network_info=[{"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:41:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:41:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1976443893',display_name='tempest-VolumesActionsTest-instance-1976443893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1976443893',id=34,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05ea7b7c3bcf4b469efa9d092e0a54f6',ramdisk_id='',reservation_id='r-egajae7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1331237735',owner_user_name='tempest-VolumesActionsTest-1331237735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:25Z,user_data=None,user_id='67910c8b82124239a88bd5d1153e6365',uuid=83129ca8-015c-4007-8840-b930bfce06e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converting VIF {"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lazy-loading 'pci_devices' on Instance uuid 83129ca8-015c-4007-8840-b930bfce06e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:41:27 user nova-compute[74820]:   <uuid>83129ca8-015c-4007-8840-b930bfce06e9</uuid>
Nov 08 18:41:27 user nova-compute[74820]:   <name>instance-00000022</name>
Nov 08 18:41:27 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:41:27 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:41:27 user nova-compute[74820]:   <metadata>
Nov 08 18:41:27 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:41:27 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:41:27 user nova-compute[74820]:       <nova:name>tempest-VolumesActionsTest-instance-1976443893</nova:name>
Nov 08 18:41:27 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:41:27</nova:creationTime>
Nov 08 18:41:27 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:41:27 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:41:27 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:41:27 user nova-compute[74820]:       <nova:owner>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:user uuid="67910c8b82124239a88bd5d1153e6365">tempest-VolumesActionsTest-1331237735-project-member</nova:user>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:project uuid="05ea7b7c3bcf4b469efa9d092e0a54f6">tempest-VolumesActionsTest-1331237735</nova:project>
Nov 08 18:41:27 user nova-compute[74820]:       </nova:owner>
Nov 08 18:41:27 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:41:27 user nova-compute[74820]:       <nova:ports>
Nov 08 18:41:27 user nova-compute[74820]:         <nova:port uuid="065ff51d-27de-49f0-a0e4-ab470961b485">
Nov 08 18:41:27 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:41:27 user nova-compute[74820]:         </nova:port>
Nov 08 18:41:27 user nova-compute[74820]:       </nova:ports>
Nov 08 18:41:27 user nova-compute[74820]:     </nova:instance>
Nov 08 18:41:27 user nova-compute[74820]:   </metadata>
Nov 08 18:41:27 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:41:27 user nova-compute[74820]:     <system>
Nov 08 18:41:27 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:41:27 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:41:27 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:41:27 user nova-compute[74820]:       <entry name="serial">83129ca8-015c-4007-8840-b930bfce06e9</entry>
Nov 08 18:41:27 user nova-compute[74820]:       <entry name="uuid">83129ca8-015c-4007-8840-b930bfce06e9</entry>
Nov 08 18:41:27 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:41:27 user nova-compute[74820]:     </system>
Nov 08 18:41:27 user nova-compute[74820]:   </sysinfo>
Nov 08 18:41:27 user nova-compute[74820]:   <os>
Nov 08 18:41:27 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:41:27 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:41:27 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:41:27 user nova-compute[74820]:   </os>
Nov 08 18:41:27 user nova-compute[74820]:   <features>
Nov 08 18:41:27 user nova-compute[74820]:     <acpi/>
Nov 08 18:41:27 user nova-compute[74820]:     <apic/>
Nov 08 18:41:27 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:41:27 user nova-compute[74820]:   </features>
Nov 08 18:41:27 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:41:27 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:41:27 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:41:27 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:41:27 user nova-compute[74820]:   </clock>
Nov 08 18:41:27 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:41:27 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:41:27 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:41:27 user nova-compute[74820]:   </cpu>
Nov 08 18:41:27 user nova-compute[74820]:   <devices>
Nov 08 18:41:27 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:41:27 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:41:27 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk"/>
Nov 08 18:41:27 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:41:27 user nova-compute[74820]:     </disk>
Nov 08 18:41:27 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:41:27 user nova-compute[74820]:       <mac address="fa:16:3e:4a:b7:e6"/>
Nov 08 18:41:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:41:27 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:41:27 user nova-compute[74820]:       <target dev="tap065ff51d-27"/>
Nov 08 18:41:27 user nova-compute[74820]:     </interface>
Nov 08 18:41:27 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:41:27 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/console.log" append="off"/>
Nov 08 18:41:27 user nova-compute[74820]:     </serial>
Nov 08 18:41:27 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:41:27 user nova-compute[74820]:     <video>
Nov 08 18:41:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:41:27 user nova-compute[74820]:     </video>
Nov 08 18:41:27 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:41:27 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:41:27 user nova-compute[74820]:     </rng>
Nov 08 18:41:27 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:41:27 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:41:27 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:41:27 user nova-compute[74820]:     </memballoon>
Nov 08 18:41:27 user nova-compute[74820]:   </devices>
Nov 08 18:41:27 user nova-compute[74820]: </domain>
Nov 08 18:41:27 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1976443893',display_name='tempest-VolumesActionsTest-instance-1976443893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1976443893',id=34,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05ea7b7c3bcf4b469efa9d092e0a54f6',ramdisk_id='',reservation_id='r-egajae7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1331237735',owner_user_name='tempest-VolumesActionsTest-1331237735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:25Z,user_data=None,user_id='67910c8b82124239a88bd5d1153e6365',uuid=83129ca8-015c-4007-8840-b930bfce06e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converting VIF {"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG os_vif [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '617d39dc-6395-58ed-8b41-cf1683778af9', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap065ff51d-27, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap065ff51d-27, col_values=(('qos', UUID('f4f31f0e-dedd-4c74-b5ac-740247c7a4c3')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap065ff51d-27, col_values=(('external_ids', {'iface-id': '065ff51d-27de-49f0-a0e4-ab470961b485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:b7:e6', 'vm-uuid': '83129ca8-015c-4007-8840-b930bfce06e9'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: INFO os_vif [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27')
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] No VIF found with MAC fa:16:3e:4a:b7:e6, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.network.neutron [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Updated VIF entry in instance network info cache for port 065ff51d-27de-49f0-a0e4-ab470961b485. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.network.neutron [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Updating instance_info_cache with network_info: [{"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-22a38ae8-68b1-4409-bb5e-c8968bfc09ea req-5d774c61-9e51-4e99-9983-a788ddbf5fd1 service nova] Releasing lock "refresh_cache-83129ca8-015c-4007-8840-b930bfce06e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.945s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:41:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.network.neutron [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:41:28 user nova-compute[74820]: DEBUG nova.policy [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d80baca13c04f37b8ea3d651536cdfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ad38240d754655a8f23b1dbc581507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:41:28 user nova-compute[74820]: INFO nova.virt.block_device [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Booting with volume snapshot 1ed3c723-a951-4e01-a7fa-5eeb3b17c1bf at /dev/vda
Nov 08 18:41:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-41a9be75-1e51-4280-a20e-d97a98f578f1 req-68f26917-ab8e-4063-80e7-239f60902821 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-41a9be75-1e51-4280-a20e-d97a98f578f1 req-68f26917-ab8e-4063-80e7-239f60902821 service nova] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-41a9be75-1e51-4280-a20e-d97a98f578f1 req-68f26917-ab8e-4063-80e7-239f60902821 service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-41a9be75-1e51-4280-a20e-d97a98f578f1 req-68f26917-ab8e-4063-80e7-239f60902821 service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-41a9be75-1e51-4280-a20e-d97a98f578f1 req-68f26917-ab8e-4063-80e7-239f60902821 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] No waiting events found dispatching network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:30 user nova-compute[74820]: WARNING nova.compute.manager [req-41a9be75-1e51-4280-a20e-d97a98f578f1 req-68f26917-ab8e-4063-80e7-239f60902821 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received unexpected event network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 for instance with vm_state building and task_state spawning.
Nov 08 18:41:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Successfully created port: 3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Successfully updated port: 3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquired lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updating instance_info_cache with network_info: [{"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Releasing lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Instance network_info: |[{"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] No waiting events found dispatching network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:32 user nova-compute[74820]: WARNING nova.compute.manager [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received unexpected event network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 for instance with vm_state building and task_state spawning.
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-changed-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Refreshing instance network info cache due to event network-changed-3c6fd632-330e-488f-880d-c606563be569. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] Acquiring lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] Acquired lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.network.neutron [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Refreshing network info cache for port 3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:41:32 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Instance spawned successfully.
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:41:32 user nova-compute[74820]: INFO nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:41:32 user nova-compute[74820]: INFO nova.compute.manager [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Took 8.49 seconds to build instance.
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cc01675-7bae-4caf-80e8-6077952e4533 tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "83129ca8-015c-4007-8840-b930bfce06e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.605s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.network.neutron [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updated VIF entry in instance network info cache for port 3c6fd632-330e-488f-880d-c606563be569. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG nova.network.neutron [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updating instance_info_cache with network_info: [{"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-84d10381-39de-4c8b-83f3-23daab00146b req-b2021b21-a908-42f7-89b8-048448f4b9c2 service nova] Releasing lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:36 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 is timed out.
Nov 08 18:41:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully detached device vdb from instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 from the live domain config.
Nov 08 18:41:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKPLTayM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:36 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[97502e62-66f4-491c-8ffa-ddc908b5b9d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:41:36 user nova-compute[74820]: No targets found.
Nov 08 18:41:36 user nova-compute[74820]: iSNS:
Nov 08 18:41:36 user nova-compute[74820]: No targets found.
Nov 08 18:41:36 user nova-compute[74820]: STATIC:
Nov 08 18:41:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802
Nov 08 18:41:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4
Nov 08 18:41:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:41:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:36 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:41:36 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:36 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:36 user nova-compute[74820]: FIRMWARE:
Nov 08 18:41:36 user nova-compute[74820]: No targets found.
Nov 08 18:41:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:41:36 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:41:36 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60ff5d3-d432-481d-9722-bea624b170f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e467a-119f-4f0d-9973-b674e66f9c4b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:36 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:36 user nova-compute[74820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)
Nov 08 18:41:36 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:36 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:36 user nova-compute[74820]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 (non-flash)
Nov 08 18:41:36 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:36 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2812c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4'): ({'sdf'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:41:36 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Removing single pathed devices sdf {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bb16d2-54ae-4376-955c-686b17391811]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edc4682-a343-409f-a0dc-89f287fff745]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Flushing IO for device /dev/sdf {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1db031-3293-4997-9aae-89cbdb4ca046]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e3967-7e64-4e44-91f7-35719b092c21]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af61393d-fcbc-4d70-97d5-af4bad0eda13]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e56e9-8c44-46ba-8776-321867702a37]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260]
Nov 08 18:41:37 user nova-compute[74820]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4, portal: 172.16.0.220,3260] successful.
Nov 08 18:41:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1134f9-e871-4afd-bffd-d3447d63bea7]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== disconnect_volume: return (339ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'flavor' on Instance uuid 94ab5fd7-d916-440a-8cfb-6a7572c242e3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-abdf3f71-d446-4aa9-9f0b-9674870d9c7f tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.088s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.961s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:38 user nova-compute[74820]: INFO nova.compute.manager [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Terminating instance
Nov 08 18:41:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-511dcb4f-c435-4098-8ded-a28ae09fdf30 req-b600c4ea-803e-4562-ba85-01a4482a0eef service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-vif-unplugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-511dcb4f-c435-4098-8ded-a28ae09fdf30 req-b600c4ea-803e-4562-ba85-01a4482a0eef service nova] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-511dcb4f-c435-4098-8ded-a28ae09fdf30 req-b600c4ea-803e-4562-ba85-01a4482a0eef service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-511dcb4f-c435-4098-8ded-a28ae09fdf30 req-b600c4ea-803e-4562-ba85-01a4482a0eef service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-511dcb4f-c435-4098-8ded-a28ae09fdf30 req-b600c4ea-803e-4562-ba85-01a4482a0eef service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] No waiting events found dispatching network-vif-unplugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-511dcb4f-c435-4098-8ded-a28ae09fdf30 req-b600c4ea-803e-4562-ba85-01a4482a0eef service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-vif-unplugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:41:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Instance destroyed successfully.
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lazy-loading 'resources' on Instance uuid 94ab5fd7-d916-440a-8cfb-6a7572c242e3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-248739429',display_name='tempest-VolumesSnapshotTestJSON-instance-248739429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-248739429',id=25,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAh/jMHbMQs3yd64Qrb6xTk2MhEYtx8LnDh7S9HbYk04yhEw2wV6KPOEoTederkqHsKboM/pW+wmDGFoc/SHZNUya6u2o7BWiNjlFkUGUhx028de2keafEfaX6H6rNWkA==',key_name='tempest-keypair-403931339',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:37:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53f1ade1323846c39c48886010ea85e9',ramdisk_id='',reservation_id='r-s0fwfsmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1628967070',owner_user_name='tempest-VolumesSnapshotTestJSON-1628967070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:37:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23005c9177444a5da028f8f60202e1fc',uuid=94ab5fd7-d916-440a-8cfb-6a7572c242e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converting VIF {"id": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "address": "fa:16:3e:3a:64:3d", "network": {"id": "9360d128-67a1-4a80-9d81-c2b7a9c65970", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-356370638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53f1ade1323846c39c48886010ea85e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4db4a79-3a", "ovs_interfaceid": "b4db4a79-3abf-4e9a-808e-9d7a1e43c754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_vif [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4db4a79-3a, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be11cb8e-34c1-4919-9c79-ba807d943e34) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: INFO os_vif [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:64:3d,bridge_name='br-int',has_traffic_filtering=True,id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754,network=Network(9360d128-67a1-4a80-9d81-c2b7a9c65970),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4db4a79-3a')
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKPLTayM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b86b6-2a06-43ac-827b-d781ffeef39a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:41:39 user nova-compute[74820]: No targets found.
Nov 08 18:41:39 user nova-compute[74820]: iSNS:
Nov 08 18:41:39 user nova-compute[74820]: No targets found.
Nov 08 18:41:39 user nova-compute[74820]: STATIC:
Nov 08 18:41:39 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802
Nov 08 18:41:39 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:39 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:39 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:41:39 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:39 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:39 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:41:39 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:41:39 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:41:39 user nova-compute[74820]: FIRMWARE:
Nov 08 18:41:39 user nova-compute[74820]: No targets found.
Nov 08 18:41:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:41:39 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:41:39 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039d05b0-8e78-4b0b-bea8-f0ae48f7f9b4', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d54dbd6-9cbc-45c4-af63-7d5354e14d98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b212553e-6c11-452f-88d8-7797dc2fba1b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:39 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:39 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:39 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:39 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e283f3370>, {}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Disconnecting from: [] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] <== disconnect_volume: return (72ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:41:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Deleting instance files /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3_del
Nov 08 18:41:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Deletion of /opt/stack/data/nova/instances/94ab5fd7-d916-440a-8cfb-6a7572c242e3_del complete
Nov 08 18:41:39 user nova-compute[74820]: INFO nova.compute.manager [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:39 user nova-compute[74820]: INFO nova.compute.manager [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Terminating instance
Nov 08 18:41:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-a55cbb28-07b9-4874-99d1-3b13ca42836c req-19e3ab25-444e-4250-899f-9ecd5ffa0c5d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-vif-unplugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a55cbb28-07b9-4874-99d1-3b13ca42836c req-19e3ab25-444e-4250-899f-9ecd5ffa0c5d service nova] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a55cbb28-07b9-4874-99d1-3b13ca42836c req-19e3ab25-444e-4250-899f-9ecd5ffa0c5d service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a55cbb28-07b9-4874-99d1-3b13ca42836c req-19e3ab25-444e-4250-899f-9ecd5ffa0c5d service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-a55cbb28-07b9-4874-99d1-3b13ca42836c req-19e3ab25-444e-4250-899f-9ecd5ffa0c5d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] No waiting events found dispatching network-vif-unplugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-a55cbb28-07b9-4874-99d1-3b13ca42836c req-19e3ab25-444e-4250-899f-9ecd5ffa0c5d service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-vif-unplugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Took 0.97 seconds to deallocate network for instance.
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-aeb2b2e7-99ad-46c3-8cab-919c7c1b6441 req-db9e22ec-e253-4aa3-8e68-64ece52d85d1 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-vif-deleted-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.compute.manager [req-aeb2b2e7-99ad-46c3-8cab-919c7c1b6441 req-db9e22ec-e253-4aa3-8e68-64ece52d85d1 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Neutron deleted interface b4db4a79-3abf-4e9a-808e-9d7a1e43c754; detaching it from the instance and deleting it from the info cache
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.network.neutron [req-aeb2b2e7-99ad-46c3-8cab-919c7c1b6441 req-db9e22ec-e253-4aa3-8e68-64ece52d85d1 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-aeb2b2e7-99ad-46c3-8cab-919c7c1b6441 req-db9e22ec-e253-4aa3-8e68-64ece52d85d1 service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Detach interface failed, port_id=b4db4a79-3abf-4e9a-808e-9d7a1e43c754, reason: Instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3 could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:41:40 user nova-compute[74820]: WARNING nova.volume.cinder [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Attachment 51c24b3f-917d-4fce-ba5f-c7e2d2a38cb5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 51c24b3f-917d-4fce-ba5f-c7e2d2a38cb5. (HTTP 404) (Request-ID: req-561a7f78-face-4d66-91bd-a8266a48e97d)
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.compute.manager [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Took 0.05 seconds to detach 1 volumes for instance.
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Instance destroyed successfully.
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lazy-loading 'resources' on Instance uuid d4bbc087-e9df-431d-9c42-9e10718e7e6d {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1864489219',display_name='tempest-VolumesAdminNegativeTest-server-1864489219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1864489219',id=20,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZnhH6xsQD3s/fvfhC17F1k/hR/x8kA6jWi0+cr6plGcwoMbTwaOQ2QYA//pUxBOuQF5mIkvwoCNQsP0Nc5uTDKXcU6sy/6avpdTMzeVy4gIoHq4CqAoO30WcckHubRqw==',key_name='tempest-keypair-1327839767',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='008fbbc99e0b4aca939d6338fdd7fa82',ramdisk_id='',reservation_id='r-sb2to0my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-571307425',owner_user_name='tempest-VolumesAdminNegativeTest-571307425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c84ad1439444413bc8a2acfffff1f2b',uuid=d4bbc087-e9df-431d-9c42-9e10718e7e6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converting VIF {"id": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "address": "fa:16:3e:bc:22:aa", "network": {"id": "4f14ad1f-08dd-48a5-b50c-850c59dc046b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591065727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "008fbbc99e0b4aca939d6338fdd7fa82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2a7475-5e", "ovs_interfaceid": "8f2a7475-5e7a-4084-9686-9e7ba1e43262", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG os_vif [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2a7475-5e, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6a930dc-3cf3-45d7-aa49-143de4a1507b) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:40 user nova-compute[74820]: INFO os_vif [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:22:aa,bridge_name='br-int',has_traffic_filtering=True,id=8f2a7475-5e7a-4084-9686-9e7ba1e43262,network=Network(4f14ad1f-08dd-48a5-b50c-850c59dc046b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2a7475-5e')
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Deleting instance files /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d_del
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Deletion of /opt/stack/data/nova/instances/d4bbc087-e9df-431d-9c42-9e10718e7e6d_del complete
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-8cfa3678-e104-4cb3-a246-bb1fe546b2ee req-2339af56-3a8e-46bf-a0e4-8ec3f5a2de0a service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received event network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8cfa3678-e104-4cb3-a246-bb1fe546b2ee req-2339af56-3a8e-46bf-a0e4-8ec3f5a2de0a service nova] Acquiring lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8cfa3678-e104-4cb3-a246-bb1fe546b2ee req-2339af56-3a8e-46bf-a0e4-8ec3f5a2de0a service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8cfa3678-e104-4cb3-a246-bb1fe546b2ee req-2339af56-3a8e-46bf-a0e4-8ec3f5a2de0a service nova] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-8cfa3678-e104-4cb3-a246-bb1fe546b2ee req-2339af56-3a8e-46bf-a0e4-8ec3f5a2de0a service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] No waiting events found dispatching network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:40 user nova-compute[74820]: WARNING nova.compute.manager [req-8cfa3678-e104-4cb3-a246-bb1fe546b2ee req-2339af56-3a8e-46bf-a0e4-8ec3f5a2de0a service nova] [instance: 94ab5fd7-d916-440a-8cfb-6a7572c242e3] Received unexpected event network-vif-plugged-b4db4a79-3abf-4e9a-808e-9d7a1e43c754 for instance with vm_state deleted and task_state None.
Nov 08 18:41:40 user nova-compute[74820]: INFO nova.compute.manager [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 08 18:41:40 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:41:40 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:41:41 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:41:41 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:41:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.674s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:41 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Deleted allocations for instance 94ab5fd7-d916-440a-8cfb-6a7572c242e3
Nov 08 18:41:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a977b0a-6906-4498-8127-a044f43f7470 tempest-VolumesSnapshotTestJSON-1628967070 tempest-VolumesSnapshotTestJSON-1628967070-project-member] Lock "94ab5fd7-d916-440a-8cfb-6a7572c242e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:41 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:41 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Took 0.96 seconds to deallocate network for instance.
Nov 08 18:41:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-e5f25982-60e9-4463-9578-79227706b8ea req-489ec363-dd25-4700-8848-ed9609ee0f04 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e5f25982-60e9-4463-9578-79227706b8ea req-489ec363-dd25-4700-8848-ed9609ee0f04 service nova] Acquiring lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e5f25982-60e9-4463-9578-79227706b8ea req-489ec363-dd25-4700-8848-ed9609ee0f04 service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e5f25982-60e9-4463-9578-79227706b8ea req-489ec363-dd25-4700-8848-ed9609ee0f04 service nova] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-e5f25982-60e9-4463-9578-79227706b8ea req-489ec363-dd25-4700-8848-ed9609ee0f04 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] No waiting events found dispatching network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:42 user nova-compute[74820]: WARNING nova.compute.manager [req-e5f25982-60e9-4463-9578-79227706b8ea req-489ec363-dd25-4700-8848-ed9609ee0f04 service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received unexpected event network-vif-plugged-8f2a7475-5e7a-4084-9686-9e7ba1e43262 for instance with vm_state deleted and task_state None.
Nov 08 18:41:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-aecc5381-82af-487a-b3ae-d0a8164e6417 req-0d0385c6-0c4f-4aef-8a19-84582291236f service nova] [instance: d4bbc087-e9df-431d-9c42-9e10718e7e6d] Received event network-vif-deleted-8f2a7475-5e7a-4084-9686-9e7ba1e43262 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.826s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:42 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Deleted allocations for instance d4bbc087-e9df-431d-9c42-9e10718e7e6d
Nov 08 18:41:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-915650d1-f7c7-4220-b945-be182a5cb239 tempest-VolumesAdminNegativeTest-571307425 tempest-VolumesAdminNegativeTest-571307425-project-member] Lock "d4bbc087-e9df-431d-9c42-9e10718e7e6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG os_brick.utils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e49c9ef-c631-4e5e-a751-ccc0c801e518]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1edf9c-77af-4e93-82b5-42b1239a65d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d069bd67-fd12-4c98-b816-a8773c76168a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc5e74-32d7-4e89-8816-4eae0ed301ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:41:45 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:41:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57ef212-fa62-4c09-bdf2-28602310c4d0]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG os_brick.utils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updating existing volume attachment record: 9d447ce2-055e-440a-8f90-867669aa144e {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:41:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:41:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:52 user nova-compute[74820]: INFO nova.compute.manager [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Rescuing
Nov 08 18:41:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updating instance_info_cache with network_info: [{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-b8229b1b-6c07-44d8-a74f-2e77f2375dbb req-69fba6f1-6f03-49fe-821b-1b91adf263a3 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b8229b1b-6c07-44d8-a74f-2e77f2375dbb req-69fba6f1-6f03-49fe-821b-1b91adf263a3 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b8229b1b-6c07-44d8-a74f-2e77f2375dbb req-69fba6f1-6f03-49fe-821b-1b91adf263a3 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b8229b1b-6c07-44d8-a74f-2e77f2375dbb req-69fba6f1-6f03-49fe-821b-1b91adf263a3 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-b8229b1b-6c07-44d8-a74f-2e77f2375dbb req-69fba6f1-6f03-49fe-821b-1b91adf263a3 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:53 user nova-compute[74820]: WARNING nova.compute.manager [req-b8229b1b-6c07-44d8-a74f-2e77f2375dbb req-69fba6f1-6f03-49fe-821b-1b91adf263a3 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state active and task_state rescuing.
Nov 08 18:41:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Starting finish_migration {{(pid=74820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:41:53 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Creating image(s)
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Ensure instance console log exists: /opt/stack/data/nova/instances/86e06d0a-11c1-4e80-8592-b71f37124e6c/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Start _get_guest_xml network_info=[{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '2c7f3a77-e419-49ad-bbea-3e977fe77394', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '86e06d0a-11c1-4e80-8592-b71f37124e6c', 'attached_at': '2023-11-08T18:41:53.000000', 'detached_at': '', 'volume_id': '100ca020-7a2a-4d32-b938-a203dec6a8e8', 'serial': '100ca020-7a2a-4d32-b938-a203dec6a8e8'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:41:53 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:41:53 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:53 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:53 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:53 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41235c43-4933-42cb-9628-7026b94c9f7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:41:53 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807a31d-7df5-41ab-99ab-6393059c4110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8] added
Nov 08 18:41:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ba499-480c-4588-8f06-86a435bcbf9d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4aa233-18e7-4e59-8abe-b3922b0be679]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWSIhZqN {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWSIhZqN" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f6dc97-0c1a-4e23-a954-255e78f310fe]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWSIhZqN'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abcfe1d-8d52-4bf2-95d1-cafe005bf1b4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1192f4-a4aa-40b9-a2b5-346a4dd1caa1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance destroyed successfully.
Nov 08 18:41:53 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Attempting a stable device rescue
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b0faa3-f1ca-4e76-9546-bf15c870088b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]
Nov 08 18:41:53 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.
Nov 08 18:41:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:41:53 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Creating image(s)
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "/opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "/opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4934f04b-40d2-4c60-a726-e3bce5b863b0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "6bddfd63647c3507152014b7e16ab6c8d1e5d0b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "6bddfd63647c3507152014b7e16ab6c8d1e5d0b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0cade5-26d1-40f9-b1a5-72b2beecc30f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:41:53 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed4af6-41e3-48cb-9ec0-7de90d1ce975]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:53 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.553s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== connect_volume: return (1555ms) {'type': 'block', 'scsi_wwn': '23439386536646661', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439386536646661', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-506693465',display_name='tempest-ServerActionsTestOtherA-server-506693465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-506693465',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-yehjp0wz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=86e06d0a-11c1-4e80-8592-b71f37124e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:41:54 user nova-compute[74820]:   <uuid>86e06d0a-11c1-4e80-8592-b71f37124e6c</uuid>
Nov 08 18:41:54 user nova-compute[74820]:   <name>instance-0000001f</name>
Nov 08 18:41:54 user nova-compute[74820]:   <memory>2097152</memory>
Nov 08 18:41:54 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:41:54 user nova-compute[74820]:   <metadata>
Nov 08 18:41:54 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:41:54 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:41:54 user nova-compute[74820]:       <nova:name>tempest-ServerActionsTestOtherA-server-506693465</nova:name>
Nov 08 18:41:54 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:41:53</nova:creationTime>
Nov 08 18:41:54 user nova-compute[74820]:       <nova:flavor name="m1.small">
Nov 08 18:41:54 user nova-compute[74820]:         <nova:memory>2048</nova:memory>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:disk>20</nova:disk>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:41:54 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:41:54 user nova-compute[74820]:       <nova:owner>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:user uuid="1a29988069fd43e0bfdb7b08a1fcc5d9">tempest-ServerActionsTestOtherA-600897548-project-member</nova:user>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:project uuid="4cdef93b9fc745768902ae1afe39ae4a">tempest-ServerActionsTestOtherA-600897548</nova:project>
Nov 08 18:41:54 user nova-compute[74820]:       </nova:owner>
Nov 08 18:41:54 user nova-compute[74820]:       <nova:ports>
Nov 08 18:41:54 user nova-compute[74820]:         <nova:port uuid="9695cc5e-3d41-4296-80f2-1b5dbfd7192a">
Nov 08 18:41:54 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:41:54 user nova-compute[74820]:         </nova:port>
Nov 08 18:41:54 user nova-compute[74820]:       </nova:ports>
Nov 08 18:41:54 user nova-compute[74820]:     </nova:instance>
Nov 08 18:41:54 user nova-compute[74820]:   </metadata>
Nov 08 18:41:54 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:41:54 user nova-compute[74820]:     <system>
Nov 08 18:41:54 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:41:54 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:41:54 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:41:54 user nova-compute[74820]:       <entry name="serial">86e06d0a-11c1-4e80-8592-b71f37124e6c</entry>
Nov 08 18:41:54 user nova-compute[74820]:       <entry name="uuid">86e06d0a-11c1-4e80-8592-b71f37124e6c</entry>
Nov 08 18:41:54 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:41:54 user nova-compute[74820]:     </system>
Nov 08 18:41:54 user nova-compute[74820]:   </sysinfo>
Nov 08 18:41:54 user nova-compute[74820]:   <os>
Nov 08 18:41:54 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:41:54 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:41:54 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:41:54 user nova-compute[74820]:   </os>
Nov 08 18:41:54 user nova-compute[74820]:   <features>
Nov 08 18:41:54 user nova-compute[74820]:     <acpi/>
Nov 08 18:41:54 user nova-compute[74820]:     <apic/>
Nov 08 18:41:54 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:41:54 user nova-compute[74820]:   </features>
Nov 08 18:41:54 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:41:54 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:41:54 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:41:54 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:41:54 user nova-compute[74820]:   </clock>
Nov 08 18:41:54 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:41:54 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:41:54 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:41:54 user nova-compute[74820]:   </cpu>
Nov 08 18:41:54 user nova-compute[74820]:   <devices>
Nov 08 18:41:54 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:41:54 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:41:54 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 18:41:54 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:41:54 user nova-compute[74820]:       <serial>100ca020-7a2a-4d32-b938-a203dec6a8e8</serial>
Nov 08 18:41:54 user nova-compute[74820]:     </disk>
Nov 08 18:41:54 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:41:54 user nova-compute[74820]:       <mac address="fa:16:3e:8f:84:ee"/>
Nov 08 18:41:54 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:41:54 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:41:54 user nova-compute[74820]:       <target dev="tap9695cc5e-3d"/>
Nov 08 18:41:54 user nova-compute[74820]:     </interface>
Nov 08 18:41:54 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:41:54 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/86e06d0a-11c1-4e80-8592-b71f37124e6c/console.log" append="off"/>
Nov 08 18:41:54 user nova-compute[74820]:     </serial>
Nov 08 18:41:54 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:41:54 user nova-compute[74820]:     <video>
Nov 08 18:41:54 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:41:54 user nova-compute[74820]:     </video>
Nov 08 18:41:54 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:41:54 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:41:54 user nova-compute[74820]:     </rng>
Nov 08 18:41:54 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:41:54 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:41:54 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:41:54 user nova-compute[74820]:     </memballoon>
Nov 08 18:41:54 user nova-compute[74820]:   </devices>
Nov 08 18:41:54 user nova-compute[74820]: </domain>
Nov 08 18:41:54 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-506693465',display_name='tempest-ServerActionsTestOtherA-server-506693465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-506693465',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-yehjp0wz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=86e06d0a-11c1-4e80-8592-b71f37124e6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1910714322-network", "vif_mac": "fa:16:3e:8f:84:ee"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG os_vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0646ec8-b195-51dd-b8a1-f3f4e8bd033f', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9695cc5e-3d, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9695cc5e-3d, col_values=(('qos', UUID('502a9463-b430-40f3-95bb-359f16f0b928')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9695cc5e-3d, col_values=(('external_ids', {'iface-id': '9695cc5e-3d41-4296-80f2-1b5dbfd7192a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:84:ee', 'vm-uuid': '86e06d0a-11c1-4e80-8592-b71f37124e6c'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:55 user nova-compute[74820]: INFO os_vif [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d')
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.part --force-share --output=json" returned: 0 in 0.257s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.virt.images [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] 936c00de-b3ab-4dd8-9acd-be24b5a342ff was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.part /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-885cc363-27c5-4bee-92b3-22bbb33af8e5 req-8045c942-0e52-492e-aeae-52bcf2d2e244 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-885cc363-27c5-4bee-92b3-22bbb33af8e5 req-8045c942-0e52-492e-aeae-52bcf2d2e244 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-885cc363-27c5-4bee-92b3-22bbb33af8e5 req-8045c942-0e52-492e-aeae-52bcf2d2e244 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-885cc363-27c5-4bee-92b3-22bbb33af8e5 req-8045c942-0e52-492e-aeae-52bcf2d2e244 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-885cc363-27c5-4bee-92b3-22bbb33af8e5 req-8045c942-0e52-492e-aeae-52bcf2d2e244 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:55 user nova-compute[74820]: WARNING nova.compute.manager [req-885cc363-27c5-4bee-92b3-22bbb33af8e5 req-8045c942-0e52-492e-aeae-52bcf2d2e244 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state active and task_state rescuing.
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] No VIF found with MAC fa:16:3e:8f:84:ee, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.part /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.converted" returned: 0 in 0.509s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "6bddfd63647c3507152014b7e16ab6c8d1e5d0b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.196s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "6bddfd63647c3507152014b7e16ab6c8d1e5d0b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "6bddfd63647c3507152014b7e16ab6c8d1e5d0b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7 --force-share --output=json" returned: 0 in 0.244s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7,backing_fmt=raw /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7,backing_fmt=raw /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue" returned: 0 in 0.077s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "6bddfd63647c3507152014b7e16ab6c8d1e5d0b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'migration_context' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<470bcaa6-f884-45ff-b3cb-08aae76c808a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Start _get_guest_xml network_info=[{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "vif_mac": "fa:16:3e:aa:aa:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '936c00de-b3ab-4dd8-9acd-be24b5a342ff', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '272f9a19-2029-4fda-825f-5b9bc446b460', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '470bcaa6-f884-45ff-b3cb-08aae76c808a', 'attached_at': '', 'detached_at': '', 'volume_id': '1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'serial': '1c7ddf10-b446-484a-afa8-0c51c2e664c3'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'resources' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<470bcaa6-f884-45ff-b3cb-08aae76c808a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'numa_topology' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<470bcaa6-f884-45ff-b3cb-08aae76c808a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:41:56 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:41:56 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<470bcaa6-f884-45ff-b3cb-08aae76c808a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:41:56 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:56 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:41:56 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4551e05-7fae-4598-8fb1-6334e1441300]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xYTgEnwk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 18:41:56 user nova-compute[74820]: node.name = iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:41:56 user nova-compute[74820]: node.tpgt = -1
Nov 08 18:41:56 user nova-compute[74820]: node.startup = automatic
Nov 08 18:41:56 user nova-compute[74820]: node.leading_login = No
Nov 08 18:41:56 user nova-compute[74820]: iface.iscsi_ifacename = default
Nov 08 18:41:56 user nova-compute[74820]: iface.net_ifacename = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.ipaddress = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.prefix_len = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.hwaddress = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.transport_name = tcp
Nov 08 18:41:56 user nova-compute[74820]: iface.initiatorname = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.vlan_id = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.vlan_priority = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.vlan_state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.iface_num = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.mtu = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.port = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.bootproto = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.subnet_mask = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.gateway = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_alt_client_id = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_dns = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_learn_iqn = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_vendor_id_state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_vendor_id = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.dhcp_slp_da = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.fragmentation = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.gratuitous_arp = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.incoming_forwarding = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.tos_state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.tos = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.ttl = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.delayed_ack = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.tcp_nagle = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.tcp_wsf_state = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.tcp_wsf = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.tcp_timer_scale = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.tcp_timestamp = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.redirect = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.def_task_mgmt_timeout = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.header_digest = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.data_digest = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.immediate_data = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.initial_r2t = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.data_seq_inorder = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.data_pdu_inorder = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.erl = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.max_receive_data_len = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.first_burst_len = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.max_outstanding_r2t = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.max_burst_len = 0
Nov 08 18:41:56 user nova-compute[74820]: iface.chap_auth = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.bidi_chap = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.strict_login_compliance = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.discovery_auth = <empty>
Nov 08 18:41:56 user nova-compute[74820]: iface.discovery_logout = <empty>
Nov 08 18:41:56 user nova-compute[74820]: node.discovery_address = <empty>
Nov 08 18:41:56 user nova-compute[74820]: node.discovery_port = 0
Nov 08 18:41:56 user nova-compute[74820]: node.discovery_type = static
Nov 08 18:41:56 user nova-compute[74820]: node.session.initial_cmdsn = 0
Nov 08 18:41:56 user nova-compute[74820]: node.session.initial_login_retry_max = 8
Nov 08 18:41:56 user nova-compute[74820]: node.session.xmit_thread_priority = -20
Nov 08 18:41:56 user nova-compute[74820]: node.session.cmds_max = 128
Nov 08 18:41:56 user nova-compute[74820]: node.session.queue_depth = 32
Nov 08 18:41:56 user nova-compute[74820]: node.session.nr_sessions = 1
Nov 08 18:41:56 user nova-compute[74820]: node.session.auth.authmethod = CHAP
Nov 08 18:41:56 user nova-compute[74820]: node.session.auth.username = xYTgEnwk
Nov 08 18:41:56 user nova-compute[74820]: node.session.auth.password = ***
Nov 08 18:41:56 user nova-compute[74820]: node.session.auth.username_in = <empty>
Nov 08 18:41:56 user nova-compute[74820]: node.session.auth.password_in = <empty>
Nov 08 18:41:56 user nova-compute[74820]: node.session.auth.chap_algs = MD5
Nov 08 18:41:56 user nova-compute[74820]: node.session.timeo.replacement_timeout = 120
Nov 08 18:41:56 user nova-compute[74820]: node.session.err_timeo.abort_timeout = 15
Nov 08 18:41:56 user nova-compute[74820]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 18:41:56 user nova-compute[74820]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 18:41:56 user nova-compute[74820]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.FastAbort = Yes
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.InitialR2T = No
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.ImmediateData = Yes
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.MaxConnections = 1
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 18:41:56 user nova-compute[74820]: node.session.iscsi.ERL = 0
Nov 08 18:41:56 user nova-compute[74820]: node.session.scan = manual
Nov 08 18:41:56 user nova-compute[74820]: node.session.reopen_max = 0
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].address = 172.16.0.220
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].port = 3260
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].startup = manual
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].tcp.window_size = 524288
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].tcp.type_of_service = 0
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].timeo.logout_timeout = 15
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].timeo.login_timeout = 15
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].timeo.auth_timeout = 45
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].iscsi.DataDigest = None
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].iscsi.IFMarker = No
Nov 08 18:41:56 user nova-compute[74820]: node.conn[0].iscsi.OFMarker = No
Nov 08 18:41:56 user nova-compute[74820]: # END RECORD
Nov 08 18:41:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6c4425-890c-470b-ae04-b7ef84cf4a97]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9725daf3-da9c-47cc-ae69-3ce2ad34ea81]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYTgEnwk {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYTgEnwk" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c9241-9286-4063-b80e-23a4aaff9b09]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYTgEnwk'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6ff93f-ccfd-4ea6-8db1-c082e11f3df4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa650b4-b896-4a2f-9c5e-056fefee08e7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:56 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:56 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:41:56 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:41:56 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:41:56 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:41:56 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:41:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] HCTL ('36', '0', '0', 0) found on session 22 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[471037d4-e6d6-4f4e-b7cd-7a673726f8bb]: (4, ('0 0 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Searching for a device in session 22 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== connect_volume: return (211ms) {'type': 'block', 'scsi_wwn': '23865613733646461', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865613733646461', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1296681237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1296681237',id=30,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-6715oa04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:40:07Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=470bcaa6-f884-45ff-b3cb-08aae76c808a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "vif_mac": "fa:16:3e:aa:aa:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "vif_mac": "fa:16:3e:aa:aa:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'pci_devices' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.objects.base [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Object Instance<470bcaa6-f884-45ff-b3cb-08aae76c808a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:41:56 user nova-compute[74820]:   <uuid>470bcaa6-f884-45ff-b3cb-08aae76c808a</uuid>
Nov 08 18:41:56 user nova-compute[74820]:   <name>instance-0000001e</name>
Nov 08 18:41:56 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:41:56 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:41:56 user nova-compute[74820]:   <metadata>
Nov 08 18:41:56 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:41:56 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:41:56 user nova-compute[74820]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1296681237</nova:name>
Nov 08 18:41:56 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:41:56</nova:creationTime>
Nov 08 18:41:56 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:41:56 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:41:56 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:41:56 user nova-compute[74820]:       <nova:owner>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:user uuid="c5790613f8a24f52897aedd0634f7f7f">tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member</nova:user>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:project uuid="e77a76c049904c6abe35b10929563c00">tempest-ServerBootFromVolumeStableRescueTest-516881030</nova:project>
Nov 08 18:41:56 user nova-compute[74820]:       </nova:owner>
Nov 08 18:41:56 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:41:56 user nova-compute[74820]:       <nova:ports>
Nov 08 18:41:56 user nova-compute[74820]:         <nova:port uuid="678c07b1-4c05-45b8-b2b8-b3aaff3d16ee">
Nov 08 18:41:56 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:41:56 user nova-compute[74820]:         </nova:port>
Nov 08 18:41:56 user nova-compute[74820]:       </nova:ports>
Nov 08 18:41:56 user nova-compute[74820]:     </nova:instance>
Nov 08 18:41:56 user nova-compute[74820]:   </metadata>
Nov 08 18:41:56 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:41:56 user nova-compute[74820]:     <system>
Nov 08 18:41:56 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:41:56 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:41:56 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:41:56 user nova-compute[74820]:       <entry name="serial">470bcaa6-f884-45ff-b3cb-08aae76c808a</entry>
Nov 08 18:41:56 user nova-compute[74820]:       <entry name="uuid">470bcaa6-f884-45ff-b3cb-08aae76c808a</entry>
Nov 08 18:41:56 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:41:56 user nova-compute[74820]:     </system>
Nov 08 18:41:56 user nova-compute[74820]:   </sysinfo>
Nov 08 18:41:56 user nova-compute[74820]:   <os>
Nov 08 18:41:56 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:41:56 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:41:56 user nova-compute[74820]:   </os>
Nov 08 18:41:56 user nova-compute[74820]:   <features>
Nov 08 18:41:56 user nova-compute[74820]:     <acpi/>
Nov 08 18:41:56 user nova-compute[74820]:     <apic/>
Nov 08 18:41:56 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:41:56 user nova-compute[74820]:   </features>
Nov 08 18:41:56 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:41:56 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:41:56 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:41:56 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:41:56 user nova-compute[74820]:   </clock>
Nov 08 18:41:56 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:41:56 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:41:56 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:41:56 user nova-compute[74820]:   </cpu>
Nov 08 18:41:56 user nova-compute[74820]:   <devices>
Nov 08 18:41:56 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:41:56 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:41:56 user nova-compute[74820]:       <source dev="/dev/sde"/>
Nov 08 18:41:56 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:41:56 user nova-compute[74820]:       <serial>1c7ddf10-b446-484a-afa8-0c51c2e664c3</serial>
Nov 08 18:41:56 user nova-compute[74820]:     </disk>
Nov 08 18:41:56 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:41:56 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:41:56 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue"/>
Nov 08 18:41:56 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:41:56 user nova-compute[74820]:       <boot order="1"/>
Nov 08 18:41:56 user nova-compute[74820]:     </disk>
Nov 08 18:41:56 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:41:56 user nova-compute[74820]:       <mac address="fa:16:3e:aa:aa:e6"/>
Nov 08 18:41:56 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:41:56 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:41:56 user nova-compute[74820]:       <target dev="tap678c07b1-4c"/>
Nov 08 18:41:56 user nova-compute[74820]:     </interface>
Nov 08 18:41:56 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:41:56 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/console.log" append="off"/>
Nov 08 18:41:56 user nova-compute[74820]:     </serial>
Nov 08 18:41:56 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:41:56 user nova-compute[74820]:     <video>
Nov 08 18:41:56 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:41:56 user nova-compute[74820]:     </video>
Nov 08 18:41:56 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:41:56 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:41:56 user nova-compute[74820]:     </rng>
Nov 08 18:41:56 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:41:56 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:41:56 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:41:56 user nova-compute[74820]:     </memballoon>
Nov 08 18:41:56 user nova-compute[74820]:   </devices>
Nov 08 18:41:56 user nova-compute[74820]: </domain>
Nov 08 18:41:56 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance destroyed successfully.
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] No VIF found with MAC fa:16:3e:aa:aa:e6, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.compute.manager [req-46e9e732-9fcb-469f-939e-e0f3a5b4c11c req-c04fba9b-e014-4600-939b-b713f8a6f4dc service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-46e9e732-9fcb-469f-939e-e0f3a5b4c11c req-c04fba9b-e014-4600-939b-b713f8a6f4dc service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-46e9e732-9fcb-469f-939e-e0f3a5b4c11c req-c04fba9b-e014-4600-939b-b713f8a6f4dc service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-46e9e732-9fcb-469f-939e-e0f3a5b4c11c req-c04fba9b-e014-4600-939b-b713f8a6f4dc service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG nova.compute.manager [req-46e9e732-9fcb-469f-939e-e0f3a5b4c11c req-c04fba9b-e014-4600-939b-b713f8a6f4dc service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:56 user nova-compute[74820]: WARNING nova.compute.manager [req-46e9e732-9fcb-469f-939e-e0f3a5b4c11c req-c04fba9b-e014-4600-939b-b713f8a6f4dc service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state active and task_state resize_finish.
Nov 08 18:41:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-cf2c761e-e9fa-48b0-a498-ca90ea925ac7 req-f42ef3c6-8de7-45b3-b224-2e88f7eb3891 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cf2c761e-e9fa-48b0-a498-ca90ea925ac7 req-f42ef3c6-8de7-45b3-b224-2e88f7eb3891 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cf2c761e-e9fa-48b0-a498-ca90ea925ac7 req-f42ef3c6-8de7-45b3-b224-2e88f7eb3891 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cf2c761e-e9fa-48b0-a498-ca90ea925ac7 req-f42ef3c6-8de7-45b3-b224-2e88f7eb3891 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-cf2c761e-e9fa-48b0-a498-ca90ea925ac7 req-f42ef3c6-8de7-45b3-b224-2e88f7eb3891 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:58 user nova-compute[74820]: WARNING nova.compute.manager [req-cf2c761e-e9fa-48b0-a498-ca90ea925ac7 req-f42ef3c6-8de7-45b3-b224-2e88f7eb3891 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state active and task_state rescuing.
Nov 08 18:41:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-40b8a327-88b9-4040-bd65-1286541fc028 req-2bbc4abe-2254-4df1-93cf-d7df8bffea83 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40b8a327-88b9-4040-bd65-1286541fc028 req-2bbc4abe-2254-4df1-93cf-d7df8bffea83 service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40b8a327-88b9-4040-bd65-1286541fc028 req-2bbc4abe-2254-4df1-93cf-d7df8bffea83 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40b8a327-88b9-4040-bd65-1286541fc028 req-2bbc4abe-2254-4df1-93cf-d7df8bffea83 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:41:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-40b8a327-88b9-4040-bd65-1286541fc028 req-2bbc4abe-2254-4df1-93cf-d7df8bffea83 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:41:59 user nova-compute[74820]: WARNING nova.compute.manager [req-40b8a327-88b9-4040-bd65-1286541fc028 req-2bbc4abe-2254-4df1-93cf-d7df8bffea83 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state active and task_state resize_finish.
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:41:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:42:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance running successfully.
Nov 08 18:42:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Failed to set time: agent not configured {{(pid=74820) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2d703911-55f4-4221-8af6-308e7116dc6e tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] finish_migration finished successfully. {{(pid=74820) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 18:42:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-e6812287-bfd2-4e7d-9eb4-409d66c33394 req-cb7e84a3-509a-435d-ae23-a4dff4aea8b2 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e6812287-bfd2-4e7d-9eb4-409d66c33394 req-cb7e84a3-509a-435d-ae23-a4dff4aea8b2 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e6812287-bfd2-4e7d-9eb4-409d66c33394 req-cb7e84a3-509a-435d-ae23-a4dff4aea8b2 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e6812287-bfd2-4e7d-9eb4-409d66c33394 req-cb7e84a3-509a-435d-ae23-a4dff4aea8b2 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-e6812287-bfd2-4e7d-9eb4-409d66c33394 req-cb7e84a3-509a-435d-ae23-a4dff4aea8b2 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:42:01 user nova-compute[74820]: WARNING nova.compute.manager [req-e6812287-bfd2-4e7d-9eb4-409d66c33394 req-cb7e84a3-509a-435d-ae23-a4dff4aea8b2 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state active and task_state rescuing.
Nov 08 18:42:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:42:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7440MB free_disk=25.00530242919922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6ffe6c9b-0985-4f63-9c5a-e7249c39ad51 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Applying migration context for instance 86e06d0a-11c1-4e80-8592-b71f37124e6c as it has an incoming, in-progress migration 091fea2f-841c-4961-baa6-fb72781a4577. Migration status is finished {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 18:42:01 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating resource usage from migration 091fea2f-841c-4961-baa6-fb72781a4577
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 470bcaa6-f884-45ff-b3cb-08aae76c808a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Migration 091fea2f-841c-4961-baa6-fb72781a4577 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 83129ca8-015c-4007-8840-b930bfce06e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dbd0dc38-4495-451d-af1a-3c00bbcec5dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:42:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:02 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [{"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-3a96e438-f59b-48f9-badf-abf0baede2ee" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:42:12 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Creating image(s)
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Ensure instance console log exists: /opt/stack/data/nova/instances/dbd0dc38-4495-451d-af1a-3c00bbcec5dc/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Start _get_guest_xml network_info=[{"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T18:41:13Z,direct_url=<?>,disk_format='qcow2',id=1243e882-9b52-4a26-89e2-90b2a0fc8b3b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1684972457',owner='f2ad38240d754655a8f23b1dbc581507',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T18:41:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '9d447ce2-055e-440a-8f90-867669aa144e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SinwGmkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbd0dc38-4495-451d-af1a-3c00bbcec5dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53', 'serial': 'ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:42:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:42:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T18:41:13Z,direct_url=<?>,disk_format='qcow2',id=1243e882-9b52-4a26-89e2-90b2a0fc8b3b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1684972457',owner='f2ad38240d754655a8f23b1dbc581507',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T18:41:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SinwGmkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:42:12 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:42:12 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:42:12 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[235dd85b-3a5f-42a1-876f-9a91acc3f06f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:42:12 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e34df-d365-452c-8623-23733ceabc36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53] added
Nov 08 18:42:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[14635517-ad37-40b8-8edb-6827f70b6989]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ea099-6dbe-4cf3-b0f1-e0541ae85a49]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SinwGmkV {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SinwGmkV" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f30f0c-842d-44f1-9358-a8999a265caa]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SinwGmkV'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa58cb-bf04-4fc6-998c-5b418517d6e2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d5a89d-1051-4c49-a13c-fadad52c01e8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:42:12 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:42:12 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:42:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:42:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:42:12 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:42:12 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:42:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:42:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d0379b-9afa-4718-86eb-f8d2d0d19caf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260]
Nov 08 18:42:12 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260] successful.
Nov 08 18:42:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e46b2f-ba41-44a8-bb86-31a9eade7147]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[089acf17-2bd4-470e-b933-5dafcb599d13]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:42:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:42:13 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:42:13 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1937511d-e37a-442b-aef1-2375f1fdc367]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:42:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SinwGmkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26233313536653234', 'path': '/dev/sdf'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233313536653234', 'path': '/dev/sdf'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1947993487',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1947993487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1947993487',id=35,image_ref='1243e882-9b52-4a26-89e2-90b2a0fc8b3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTSanWDsHfZPV7xLzA1wXzyf7eiJwnvncVOVJ3mhYJ49HAn66FzQK8DPUhqVYMjkGrOigoWJgg1b84i1GWHIiHWeEnx0CA5Qi15l61eGxCNJU82aw7OjXQg3tDYw04clQ==',key_name='tempest-keypair-928541697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-lj6hf7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1148056077',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=dbd0dc38-4495-451d-af1a-3c00bbcec5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.objects.instance [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'pci_devices' on Instance uuid dbd0dc38-4495-451d-af1a-3c00bbcec5dc {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:42:14 user nova-compute[74820]:   <uuid>dbd0dc38-4495-451d-af1a-3c00bbcec5dc</uuid>
Nov 08 18:42:14 user nova-compute[74820]:   <name>instance-00000023</name>
Nov 08 18:42:14 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:42:14 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:42:14 user nova-compute[74820]:   <metadata>
Nov 08 18:42:14 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:42:14 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:42:14 user nova-compute[74820]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1947993487</nova:name>
Nov 08 18:42:14 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:42:12</nova:creationTime>
Nov 08 18:42:14 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:42:14 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:42:14 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:42:14 user nova-compute[74820]:       <nova:owner>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:user uuid="4d80baca13c04f37b8ea3d651536cdfd">tempest-TestVolumeBootPattern-1148056077-project-member</nova:user>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:project uuid="f2ad38240d754655a8f23b1dbc581507">tempest-TestVolumeBootPattern-1148056077</nova:project>
Nov 08 18:42:14 user nova-compute[74820]:       </nova:owner>
Nov 08 18:42:14 user nova-compute[74820]:       <nova:root type="image" uuid="1243e882-9b52-4a26-89e2-90b2a0fc8b3b"/>
Nov 08 18:42:14 user nova-compute[74820]:       <nova:ports>
Nov 08 18:42:14 user nova-compute[74820]:         <nova:port uuid="3c6fd632-330e-488f-880d-c606563be569">
Nov 08 18:42:14 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 18:42:14 user nova-compute[74820]:         </nova:port>
Nov 08 18:42:14 user nova-compute[74820]:       </nova:ports>
Nov 08 18:42:14 user nova-compute[74820]:     </nova:instance>
Nov 08 18:42:14 user nova-compute[74820]:   </metadata>
Nov 08 18:42:14 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:42:14 user nova-compute[74820]:     <system>
Nov 08 18:42:14 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:42:14 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:42:14 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:42:14 user nova-compute[74820]:       <entry name="serial">dbd0dc38-4495-451d-af1a-3c00bbcec5dc</entry>
Nov 08 18:42:14 user nova-compute[74820]:       <entry name="uuid">dbd0dc38-4495-451d-af1a-3c00bbcec5dc</entry>
Nov 08 18:42:14 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:42:14 user nova-compute[74820]:     </system>
Nov 08 18:42:14 user nova-compute[74820]:   </sysinfo>
Nov 08 18:42:14 user nova-compute[74820]:   <os>
Nov 08 18:42:14 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:42:14 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:42:14 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:42:14 user nova-compute[74820]:   </os>
Nov 08 18:42:14 user nova-compute[74820]:   <features>
Nov 08 18:42:14 user nova-compute[74820]:     <acpi/>
Nov 08 18:42:14 user nova-compute[74820]:     <apic/>
Nov 08 18:42:14 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:42:14 user nova-compute[74820]:   </features>
Nov 08 18:42:14 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:42:14 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:42:14 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:42:14 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:42:14 user nova-compute[74820]:   </clock>
Nov 08 18:42:14 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:42:14 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:42:14 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:42:14 user nova-compute[74820]:   </cpu>
Nov 08 18:42:14 user nova-compute[74820]:   <devices>
Nov 08 18:42:14 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:42:14 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:42:14 user nova-compute[74820]:       <source dev="/dev/sdf"/>
Nov 08 18:42:14 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:42:14 user nova-compute[74820]:       <serial>ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53</serial>
Nov 08 18:42:14 user nova-compute[74820]:     </disk>
Nov 08 18:42:14 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:42:14 user nova-compute[74820]:       <mac address="fa:16:3e:af:91:36"/>
Nov 08 18:42:14 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:42:14 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:42:14 user nova-compute[74820]:       <target dev="tap3c6fd632-33"/>
Nov 08 18:42:14 user nova-compute[74820]:     </interface>
Nov 08 18:42:14 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:42:14 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/dbd0dc38-4495-451d-af1a-3c00bbcec5dc/console.log" append="off"/>
Nov 08 18:42:14 user nova-compute[74820]:     </serial>
Nov 08 18:42:14 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:42:14 user nova-compute[74820]:     <video>
Nov 08 18:42:14 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:42:14 user nova-compute[74820]:     </video>
Nov 08 18:42:14 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:42:14 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:42:14 user nova-compute[74820]:     </rng>
Nov 08 18:42:14 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:42:14 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:42:14 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:42:14 user nova-compute[74820]:     </memballoon>
Nov 08 18:42:14 user nova-compute[74820]:   </devices>
Nov 08 18:42:14 user nova-compute[74820]: </domain>
Nov 08 18:42:14 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1947993487',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1947993487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1947993487',id=35,image_ref='1243e882-9b52-4a26-89e2-90b2a0fc8b3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTSanWDsHfZPV7xLzA1wXzyf7eiJwnvncVOVJ3mhYJ49HAn66FzQK8DPUhqVYMjkGrOigoWJgg1b84i1GWHIiHWeEnx0CA5Qi15l61eGxCNJU82aw7OjXQg3tDYw04clQ==',key_name='tempest-keypair-928541697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-lj6hf7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1148056077',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=dbd0dc38-4495-451d-af1a-3c00bbcec5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG os_vif [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '564b1bf1-3bd9-56ee-a4bf-f8c23aef1df6', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c6fd632-33, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c6fd632-33, col_values=(('qos', UUID('a26d8f92-82c5-431e-a404-01b5bfb64158')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c6fd632-33, col_values=(('external_ids', {'iface-id': '3c6fd632-330e-488f-880d-c606563be569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:91:36', 'vm-uuid': 'dbd0dc38-4495-451d-af1a-3c00bbcec5dc'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:14 user nova-compute[74820]: INFO os_vif [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33')
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:42:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No VIF found with MAC fa:16:3e:af:91:36, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:42:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-16c66573-8e98-4219-bfcf-75b675dea3b6 req-8b3d5587-08bd-479d-803c-ed064ef1f22f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:42:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-16c66573-8e98-4219-bfcf-75b675dea3b6 req-8b3d5587-08bd-479d-803c-ed064ef1f22f service nova] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-16c66573-8e98-4219-bfcf-75b675dea3b6 req-8b3d5587-08bd-479d-803c-ed064ef1f22f service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-16c66573-8e98-4219-bfcf-75b675dea3b6 req-8b3d5587-08bd-479d-803c-ed064ef1f22f service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-16c66573-8e98-4219-bfcf-75b675dea3b6 req-8b3d5587-08bd-479d-803c-ed064ef1f22f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] No waiting events found dispatching network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:42:16 user nova-compute[74820]: WARNING nova.compute.manager [req-16c66573-8e98-4219-bfcf-75b675dea3b6 req-8b3d5587-08bd-479d-803c-ed064ef1f22f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received unexpected event network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 for instance with vm_state building and task_state spawning.
Nov 08 18:42:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4b00e07-500c-43ad-8e12-791865e3c23d req-6934db4e-6c84-4afb-b0f2-8345eee9ff39 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4b00e07-500c-43ad-8e12-791865e3c23d req-6934db4e-6c84-4afb-b0f2-8345eee9ff39 service nova] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4b00e07-500c-43ad-8e12-791865e3c23d req-6934db4e-6c84-4afb-b0f2-8345eee9ff39 service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4b00e07-500c-43ad-8e12-791865e3c23d req-6934db4e-6c84-4afb-b0f2-8345eee9ff39 service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4b00e07-500c-43ad-8e12-791865e3c23d req-6934db4e-6c84-4afb-b0f2-8345eee9ff39 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] No waiting events found dispatching network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:42:18 user nova-compute[74820]: WARNING nova.compute.manager [req-e4b00e07-500c-43ad-8e12-791865e3c23d req-6934db4e-6c84-4afb-b0f2-8345eee9ff39 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received unexpected event network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 for instance with vm_state building and task_state spawning.
Nov 08 18:42:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:42:18 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Instance spawned successfully.
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:42:18 user nova-compute[74820]: INFO nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 08 18:42:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:42:18 user nova-compute[74820]: INFO nova.compute.manager [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Took 50.67 seconds to build instance.
Nov 08 18:42:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-43a44f33-3171-480d-b4c7-1cbaacf331c9 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.801s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-changed-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Refreshing instance network info cache due to event network-changed-5af42030-70b7-4c1d-a37e-96f61319a9c8. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] Acquiring lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] Acquired lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:42:34 user nova-compute[74820]: DEBUG nova.network.neutron [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Refreshing network info cache for port 5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:42:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updated VIF entry in instance network info cache for port 5af42030-70b7-4c1d-a37e-96f61319a9c8. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:42:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updating instance_info_cache with network_info: [{"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:42:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f42658fd-a653-49bf-b65b-39476ae34762 req-b9d0cb4f-ebcf-42ac-bb95-fc2afc39e6d3 service nova] Releasing lock "refresh_cache-f3ae0593-3d03-4b93-b444-6d5c4ef414c3" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:42:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:42:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:41 user nova-compute[74820]: INFO nova.compute.manager [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Attaching volume 140bbc64-e0d5-4920-a786-65e68a2b540a to /dev/vdb
Nov 08 18:42:41 user nova-compute[74820]: DEBUG os_brick.utils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66decea-9a11-4348-801d-d1f662395260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b480df3-0c0e-4d86-8b00-b2915046709b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3229f86-1cac-4d9c-b9e1-f2d9d5f1a587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c31734d-6986-454f-9ba8-185259567558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:42:41 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:42:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af821397-80ec-49d8-af3a-cd86ae686209]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG os_brick.utils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:42:41 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updating existing volume attachment record: 87865ad1-2f1c-4b67-b173-3037e1a4b67c {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:42:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:42:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:49 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:42:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:42:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:42:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:42:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:42:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:42:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:42:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:42:55 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:42:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:43:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7043MB free_disk=24.999629974365234GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Applying migration context for instance 86e06d0a-11c1-4e80-8592-b71f37124e6c as it has an incoming, in-progress migration 091fea2f-841c-4961-baa6-fb72781a4577. Migration status is finished {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 18:43:01 user nova-compute[74820]: INFO nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating resource usage from migration 091fea2f-841c-4961-baa6-fb72781a4577
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d59095c8-d793-4257-a980-63be74e48c7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 470bcaa6-f884-45ff-b3cb-08aae76c808a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Migration 091fea2f-841c-4961-baa6-fb72781a4577 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 83129ca8-015c-4007-8840-b930bfce06e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dbd0dc38-4495-451d-af1a-3c00bbcec5dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:43:01 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:43:02 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:43:02 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:43:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.012s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: c51df6e9-c969-4869-88be-77c877029dde] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [{"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-c51df6e9-c969-4869-88be-77c877029dde" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:43:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "d59095c8-d793-4257-a980-63be74e48c7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:10 user nova-compute[74820]: INFO nova.compute.manager [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Terminating instance
Nov 08 18:43:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-a33e7bdf-e908-42e8-955c-34c719357efb req-ec557e31-9168-41c1-8b5f-e80988e8754d service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-vif-unplugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a33e7bdf-e908-42e8-955c-34c719357efb req-ec557e31-9168-41c1-8b5f-e80988e8754d service nova] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a33e7bdf-e908-42e8-955c-34c719357efb req-ec557e31-9168-41c1-8b5f-e80988e8754d service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a33e7bdf-e908-42e8-955c-34c719357efb req-ec557e31-9168-41c1-8b5f-e80988e8754d service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-a33e7bdf-e908-42e8-955c-34c719357efb req-ec557e31-9168-41c1-8b5f-e80988e8754d service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] No waiting events found dispatching network-vif-unplugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-a33e7bdf-e908-42e8-955c-34c719357efb req-ec557e31-9168-41c1-8b5f-e80988e8754d service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-vif-unplugged-8530850e-e922-4941-bc82-4c4b85a7eb4c for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:43:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Instance destroyed successfully.
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lazy-loading 'resources' on Instance uuid d59095c8-d793-4257-a980-63be74e48c7a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1977219225',display_name='tempest-ServersNegativeTestJSON-server-1977219225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1977219225',id=17,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16d2eda9ff724b288680a1ac55e667ce',ramdisk_id='',reservation_id='r-e4fyhvpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-816870962',owner_user_name='tempest-ServersNegativeTestJSON-816870962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:33:30Z,user_data=None,user_id='da2d9ad108da46cca9b8c5d870e8076d',uuid=d59095c8-d793-4257-a980-63be74e48c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converting VIF {"id": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "address": "fa:16:3e:4e:e4:68", "network": {"id": "feba59b1-2ffe-4f22-b526-b40df438ee69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-131804575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d2eda9ff724b288680a1ac55e667ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8530850e-e9", "ovs_interfaceid": "8530850e-e922-4941-bc82-4c4b85a7eb4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG os_vif [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8530850e-e9, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a16d543-b266-4193-8d64-e128068057df) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:11 user nova-compute[74820]: INFO os_vif [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e4:68,bridge_name='br-int',has_traffic_filtering=True,id=8530850e-e922-4941-bc82-4c4b85a7eb4c,network=Network(feba59b1-2ffe-4f22-b526-b40df438ee69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8530850e-e9')
Nov 08 18:43:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Deleting instance files /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a_del
Nov 08 18:43:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Deletion of /opt/stack/data/nova/instances/d59095c8-d793-4257-a980-63be74e48c7a_del complete
Nov 08 18:43:11 user nova-compute[74820]: INFO nova.compute.manager [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 18:43:11 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: d59095c8-d793-4257-a980-63be74e48c7a] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:11 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Took 0.54 seconds to deallocate network for instance.
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-73707c5c-1945-478f-94ba-5a8209255069 req-8f1f46bb-e919-499d-a5e5-6059bb042bfc service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-vif-deleted-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:11 user nova-compute[74820]: INFO nova.compute.manager [req-73707c5c-1945-478f-94ba-5a8209255069 req-8f1f46bb-e919-499d-a5e5-6059bb042bfc service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Neutron deleted interface 8530850e-e922-4941-bc82-4c4b85a7eb4c; detaching it from the instance and deleting it from the info cache
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-73707c5c-1945-478f-94ba-5a8209255069 req-8f1f46bb-e919-499d-a5e5-6059bb042bfc service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-73707c5c-1945-478f-94ba-5a8209255069 req-8f1f46bb-e919-499d-a5e5-6059bb042bfc service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Detach interface failed, port_id=8530850e-e922-4941-bc82-4c4b85a7eb4c, reason: Instance d59095c8-d793-4257-a980-63be74e48c7a could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:12 user nova-compute[74820]: WARNING nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 3a96e438-f59b-48f9-badf-abf0baede2ee {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 5ffeef93-63b0-4dab-a336-f2946b4cbae1 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 86e06d0a-11c1-4e80-8592-b71f37124e6c {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid c9b0f5f4-1d2a-476c-8a31-56f2e87b676e {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 83129ca8-015c-4007-8840-b930bfce06e9 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid dbd0dc38-4495-451d-af1a-3c00bbcec5dc {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid d59095c8-d793-4257-a980-63be74e48c7a {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "c51df6e9-c969-4869-88be-77c877029dde" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "83129ca8-015c-4007-8840-b930bfce06e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "c51df6e9-c969-4869-88be-77c877029dde" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "83129ca8-015c-4007-8840-b930bfce06e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Deleted allocations for instance d59095c8-d793-4257-a980-63be74e48c7a
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1e249a8e-550c-4fc3-bb0d-37882d481ac4 tempest-ServersNegativeTestJSON-816870962 tempest-ServersNegativeTestJSON-816870962-project-member] Lock "d59095c8-d793-4257-a980-63be74e48c7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "d59095c8-d793-4257-a980-63be74e48c7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.289s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "d59095c8-d793-4257-a980-63be74e48c7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-5254a611-c557-4534-bcd2-39a1cd0e0817 req-29d08cb9-14ca-442f-8978-ec25f1160de5 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received event network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5254a611-c557-4534-bcd2-39a1cd0e0817 req-29d08cb9-14ca-442f-8978-ec25f1160de5 service nova] Acquiring lock "d59095c8-d793-4257-a980-63be74e48c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5254a611-c557-4534-bcd2-39a1cd0e0817 req-29d08cb9-14ca-442f-8978-ec25f1160de5 service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5254a611-c557-4534-bcd2-39a1cd0e0817 req-29d08cb9-14ca-442f-8978-ec25f1160de5 service nova] Lock "d59095c8-d793-4257-a980-63be74e48c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:12 user nova-compute[74820]: DEBUG nova.compute.manager [req-5254a611-c557-4534-bcd2-39a1cd0e0817 req-29d08cb9-14ca-442f-8978-ec25f1160de5 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] No waiting events found dispatching network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:12 user nova-compute[74820]: WARNING nova.compute.manager [req-5254a611-c557-4534-bcd2-39a1cd0e0817 req-29d08cb9-14ca-442f-8978-ec25f1160de5 service nova] [instance: d59095c8-d793-4257-a980-63be74e48c7a] Received unexpected event network-vif-plugged-8530850e-e922-4941-bc82-4c4b85a7eb4c for instance with vm_state deleted and task_state None.
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "83129ca8-015c-4007-8840-b930bfce06e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:15 user nova-compute[74820]: INFO nova.compute.manager [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Terminating instance
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-8766aa83-59ff-4f13-b1fe-2a98f734577b req-24e03103-fca9-427f-8251-dacbe54cfecc service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-vif-unplugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8766aa83-59ff-4f13-b1fe-2a98f734577b req-24e03103-fca9-427f-8251-dacbe54cfecc service nova] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8766aa83-59ff-4f13-b1fe-2a98f734577b req-24e03103-fca9-427f-8251-dacbe54cfecc service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8766aa83-59ff-4f13-b1fe-2a98f734577b req-24e03103-fca9-427f-8251-dacbe54cfecc service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-8766aa83-59ff-4f13-b1fe-2a98f734577b req-24e03103-fca9-427f-8251-dacbe54cfecc service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] No waiting events found dispatching network-vif-unplugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-8766aa83-59ff-4f13-b1fe-2a98f734577b req-24e03103-fca9-427f-8251-dacbe54cfecc service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-vif-unplugged-065ff51d-27de-49f0-a0e4-ab470961b485 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:43:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Instance destroyed successfully.
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lazy-loading 'resources' on Instance uuid 83129ca8-015c-4007-8840-b930bfce06e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1976443893',display_name='tempest-VolumesActionsTest-instance-1976443893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1976443893',id=34,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05ea7b7c3bcf4b469efa9d092e0a54f6',ramdisk_id='',reservation_id='r-egajae7v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1331237735',owner_user_name='tempest-VolumesActionsTest-1331237735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:41:33Z,user_data=None,user_id='67910c8b82124239a88bd5d1153e6365',uuid=83129ca8-015c-4007-8840-b930bfce06e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converting VIF {"id": "065ff51d-27de-49f0-a0e4-ab470961b485", "address": "fa:16:3e:4a:b7:e6", "network": {"id": "202fa8bf-eb11-4a4c-8582-43d3aa32cd60", "bridge": "br-int", "label": "tempest-VolumesActionsTest-719608695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05ea7b7c3bcf4b469efa9d092e0a54f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap065ff51d-27", "ovs_interfaceid": "065ff51d-27de-49f0-a0e4-ab470961b485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG os_vif [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap065ff51d-27, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4f31f0e-dedd-4c74-b5ac-740247c7a4c3) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:43:15 user nova-compute[74820]: INFO os_vif [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b7:e6,bridge_name='br-int',has_traffic_filtering=True,id=065ff51d-27de-49f0-a0e4-ab470961b485,network=Network(202fa8bf-eb11-4a4c-8582-43d3aa32cd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap065ff51d-27')
Nov 08 18:43:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Deleting instance files /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9_del
Nov 08 18:43:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Deletion of /opt/stack/data/nova/instances/83129ca8-015c-4007-8840-b930bfce06e9_del complete
Nov 08 18:43:15 user nova-compute[74820]: INFO nova.compute.manager [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 08 18:43:15 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:43:15 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:43:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:16 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:16 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Took 0.98 seconds to deallocate network for instance.
Nov 08 18:43:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:17 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Deleted allocations for instance 83129ca8-015c-4007-8840-b930bfce06e9
Nov 08 18:43:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7517233e-3d29-443c-9ae2-40bd294725ea tempest-VolumesActionsTest-1331237735 tempest-VolumesActionsTest-1331237735-project-member] Lock "83129ca8-015c-4007-8840-b930bfce06e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.356s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] Acquiring lock "83129ca8-015c-4007-8840-b930bfce06e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] Lock "83129ca8-015c-4007-8840-b930bfce06e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] No waiting events found dispatching network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:17 user nova-compute[74820]: WARNING nova.compute.manager [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received unexpected event network-vif-plugged-065ff51d-27de-49f0-a0e4-ab470961b485 for instance with vm_state deleted and task_state None.
Nov 08 18:43:17 user nova-compute[74820]: DEBUG nova.compute.manager [req-710ee82b-6609-40e0-b787-d9c8c23290df req-2f50ac11-2503-4ae2-9f5c-cba5904fc3f9 service nova] [instance: 83129ca8-015c-4007-8840-b930bfce06e9] Received event network-vif-deleted-065ff51d-27de-49f0-a0e4-ab470961b485 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:25 user nova-compute[74820]: INFO nova.compute.manager [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Rescuing
Nov 08 18:43:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGyweTSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:43:25 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:43:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:43:25 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:43:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:43:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:43:25 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:43:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e870af83-7c77-473a-88a4-bcdb30ed76c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:43:26 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c30647-32c5-485e-8e00-a932789ac2ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a] added
Nov 08 18:43:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc8e8a-0c8a-47fc-bf54-5f244f22ff48]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e447fd1f-b60d-4517-b257-c6d579f82984]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mGyweTSK {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mGyweTSK" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6349f67d-0b0a-4c18-9fc9-f01e9453e56f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mGyweTSK'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b942f361-accf-45cd-ade0-615afe4d3eab]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b728148-acf1-497d-b035-3b4906c3c97c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:43:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:43:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd21dd1c-cbd2-4bf7-914a-cd15ad548907]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260]
Nov 08 18:43:26 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260] successful.
Nov 08 18:43:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66c399a-7905-4a6d-880f-8869278174f0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d23a94-a505-4bc0-8246-c24ef2b3ed98]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:43:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a (non-flash)
Nov 08 18:43:26 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:43:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeaec6f-0bb2-497a-bd1e-7b196227719b]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGyweTSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e56d89d-ee6a-446a-9b31-cc7c44f27304 req-dcce2430-d7d3-4b97-a656-57993d044428 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e56d89d-ee6a-446a-9b31-cc7c44f27304 req-dcce2430-d7d3-4b97-a656-57993d044428 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e56d89d-ee6a-446a-9b31-cc7c44f27304 req-dcce2430-d7d3-4b97-a656-57993d044428 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e56d89d-ee6a-446a-9b31-cc7c44f27304 req-dcce2430-d7d3-4b97-a656-57993d044428 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e56d89d-ee6a-446a-9b31-cc7c44f27304 req-dcce2430-d7d3-4b97-a656-57993d044428 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:26 user nova-compute[74820]: WARNING nova.compute.manager [req-6e56d89d-ee6a-446a-9b31-cc7c44f27304 req-dcce2430-d7d3-4b97-a656-57993d044428 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state active and task_state rescuing.
Nov 08 18:43:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:27 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance destroyed successfully.
Nov 08 18:43:27 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Attempting rescue
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:43:27 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Creating image(s)
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23630396465386562', 'path': '/dev/sdg'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630396465386562', 'path': '/dev/sdg'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:43:27 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:43:27 user nova-compute[74820]:   <source dev="/dev/sdg"/>
Nov 08 18:43:27 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:43:27 user nova-compute[74820]:   <serial>140bbc64-e0d5-4920-a786-65e68a2b540a</serial>
Nov 08 18:43:27 user nova-compute[74820]: </disk>
Nov 08 18:43:27 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue" returned: 0 in 0.053s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'migration_context' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.base [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<81728aff-572d-4015-b0a4-c299022d4ea1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Start _get_guest_xml network_info=[{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:91:fc:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'resources' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.base [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<81728aff-572d-4015-b0a4-c299022d4ea1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'numa_topology' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.base [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<81728aff-572d-4015-b0a4-c299022d4ea1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:43:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:43:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.base [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<81728aff-572d-4015-b0a4-c299022d4ea1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2136003210',display_name='tempest-ServerRescueNegativeTestJSON-server-2136003210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2136003210',id=26,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-iicek56j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:38:30Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=81728aff-572d-4015-b0a4-c299022d4ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:91:fc:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:91:fc:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'pci_devices' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.objects.base [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<81728aff-572d-4015-b0a4-c299022d4ea1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:43:27 user nova-compute[74820]:   <uuid>81728aff-572d-4015-b0a4-c299022d4ea1</uuid>
Nov 08 18:43:27 user nova-compute[74820]:   <name>instance-0000001a</name>
Nov 08 18:43:27 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:43:27 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:43:27 user nova-compute[74820]:   <metadata>
Nov 08 18:43:27 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:43:27 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:43:27 user nova-compute[74820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2136003210</nova:name>
Nov 08 18:43:27 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:43:27</nova:creationTime>
Nov 08 18:43:27 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:43:27 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:43:27 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:43:27 user nova-compute[74820]:       <nova:owner>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:user uuid="cb2804c2bc374d52a2283e78f03959c6">tempest-ServerRescueNegativeTestJSON-1619361117-project-member</nova:user>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:project uuid="622d25fd48684d82bb673a57cf0a7928">tempest-ServerRescueNegativeTestJSON-1619361117</nova:project>
Nov 08 18:43:27 user nova-compute[74820]:       </nova:owner>
Nov 08 18:43:27 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:43:27 user nova-compute[74820]:       <nova:ports>
Nov 08 18:43:27 user nova-compute[74820]:         <nova:port uuid="0096d7ac-f51d-46f5-add9-59141b6a0588">
Nov 08 18:43:27 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 18:43:27 user nova-compute[74820]:         </nova:port>
Nov 08 18:43:27 user nova-compute[74820]:       </nova:ports>
Nov 08 18:43:27 user nova-compute[74820]:     </nova:instance>
Nov 08 18:43:27 user nova-compute[74820]:   </metadata>
Nov 08 18:43:27 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:43:27 user nova-compute[74820]:     <system>
Nov 08 18:43:27 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:43:27 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:43:27 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:43:27 user nova-compute[74820]:       <entry name="serial">81728aff-572d-4015-b0a4-c299022d4ea1</entry>
Nov 08 18:43:27 user nova-compute[74820]:       <entry name="uuid">81728aff-572d-4015-b0a4-c299022d4ea1</entry>
Nov 08 18:43:27 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:43:27 user nova-compute[74820]:     </system>
Nov 08 18:43:27 user nova-compute[74820]:   </sysinfo>
Nov 08 18:43:27 user nova-compute[74820]:   <os>
Nov 08 18:43:27 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:43:27 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:43:27 user nova-compute[74820]:   </os>
Nov 08 18:43:27 user nova-compute[74820]:   <features>
Nov 08 18:43:27 user nova-compute[74820]:     <acpi/>
Nov 08 18:43:27 user nova-compute[74820]:     <apic/>
Nov 08 18:43:27 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:43:27 user nova-compute[74820]:   </features>
Nov 08 18:43:27 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:43:27 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:43:27 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:43:27 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:43:27 user nova-compute[74820]:   </clock>
Nov 08 18:43:27 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:43:27 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:43:27 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:43:27 user nova-compute[74820]:   </cpu>
Nov 08 18:43:27 user nova-compute[74820]:   <devices>
Nov 08 18:43:27 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:43:27 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:43:27 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue"/>
Nov 08 18:43:27 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:43:27 user nova-compute[74820]:     </disk>
Nov 08 18:43:27 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:43:27 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:43:27 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk"/>
Nov 08 18:43:27 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:43:27 user nova-compute[74820]:     </disk>
Nov 08 18:43:27 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:43:27 user nova-compute[74820]:       <mac address="fa:16:3e:91:fc:b8"/>
Nov 08 18:43:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:43:27 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:43:27 user nova-compute[74820]:       <target dev="tap0096d7ac-f5"/>
Nov 08 18:43:27 user nova-compute[74820]:     </interface>
Nov 08 18:43:27 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:43:27 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/console.log" append="off"/>
Nov 08 18:43:27 user nova-compute[74820]:     </serial>
Nov 08 18:43:27 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:43:27 user nova-compute[74820]:     <video>
Nov 08 18:43:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:43:27 user nova-compute[74820]:     </video>
Nov 08 18:43:27 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:43:27 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:43:27 user nova-compute[74820]:     </rng>
Nov 08 18:43:27 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:43:27 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:43:27 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:43:27 user nova-compute[74820]:     </memballoon>
Nov 08 18:43:27 user nova-compute[74820]:   </devices>
Nov 08 18:43:27 user nova-compute[74820]: </domain>
Nov 08 18:43:27 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:43:27 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance destroyed successfully.
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:91:fc:b8, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:43:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] No VIF found with MAC fa:16:3e:13:06:66, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f8cf7f66-84c9-47f3-bf89-f16c534aaff0 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.902s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.923s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-59542171-1159-417b-9c6c-7b5af58b6491 req-7061d85b-3f04-4960-9fc7-07c209d6fac8 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59542171-1159-417b-9c6c-7b5af58b6491 req-7061d85b-3f04-4960-9fc7-07c209d6fac8 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59542171-1159-417b-9c6c-7b5af58b6491 req-7061d85b-3f04-4960-9fc7-07c209d6fac8 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59542171-1159-417b-9c6c-7b5af58b6491 req-7061d85b-3f04-4960-9fc7-07c209d6fac8 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-59542171-1159-417b-9c6c-7b5af58b6491 req-7061d85b-3f04-4960-9fc7-07c209d6fac8 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:28 user nova-compute[74820]: WARNING nova.compute.manager [req-59542171-1159-417b-9c6c-7b5af58b6491 req-7061d85b-3f04-4960-9fc7-07c209d6fac8 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state active and task_state rescuing.
Nov 08 18:43:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:29 user nova-compute[74820]: INFO nova.compute.manager [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Detaching volume 140bbc64-e0d5-4920-a786-65e68a2b540a
Nov 08 18:43:29 user nova-compute[74820]: INFO nova.virt.block_device [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Attempting to driver detach volume 140bbc64-e0d5-4920-a786-65e68a2b540a from mountpoint /dev/vdb
Nov 08 18:43:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Attempting to detach device vdb from instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:43:29 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:43:29 user nova-compute[74820]:   <source dev="/dev/sdg"/>
Nov 08 18:43:29 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:43:29 user nova-compute[74820]:   <serial>140bbc64-e0d5-4920-a786-65e68a2b540a</serial>
Nov 08 18:43:29 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:43:29 user nova-compute[74820]: </disk>
Nov 08 18:43:29 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:43:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully detached device vdb from instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 from the persistent domain config.
Nov 08 18:43:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:43:29 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:43:29 user nova-compute[74820]:   <source dev="/dev/sdg"/>
Nov 08 18:43:29 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:43:29 user nova-compute[74820]:   <serial>140bbc64-e0d5-4920-a786-65e68a2b540a</serial>
Nov 08 18:43:29 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:43:29 user nova-compute[74820]: </disk>
Nov 08 18:43:29 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:30 user nova-compute[74820]: WARNING nova.compute.manager [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state active and task_state rescuing.
Nov 08 18:43:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:30 user nova-compute[74820]: WARNING nova.compute.manager [req-e078472b-48ea-413e-b17f-6291563f9857 req-c89952a8-3fde-495e-94c7-5b238512e411 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state active and task_state rescuing.
Nov 08 18:43:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-072c5eb6-aa92-4c99-bf37-48a93049c768 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:43:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:43:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:43:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:43:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:43:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:43 user nova-compute[74820]: INFO nova.compute.manager [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Unrescuing
Nov 08 18:43:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:43:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquired lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:43:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:43:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updating instance_info_cache with network_info: [{"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Releasing lock "refresh_cache-470bcaa6-f884-45ff-b3cb-08aae76c808a" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:43:43 user nova-compute[74820]: DEBUG nova.objects.instance [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'flavor' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c31be9c-9fbd-44d1-94cb-b61a766c865c req-a7c8bef5-16b8-439a-b4e8-2800675231eb service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c31be9c-9fbd-44d1-94cb-b61a766c865c req-a7c8bef5-16b8-439a-b4e8-2800675231eb service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c31be9c-9fbd-44d1-94cb-b61a766c865c req-a7c8bef5-16b8-439a-b4e8-2800675231eb service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0c31be9c-9fbd-44d1-94cb-b61a766c865c req-a7c8bef5-16b8-439a-b4e8-2800675231eb service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-0c31be9c-9fbd-44d1-94cb-b61a766c865c req-a7c8bef5-16b8-439a-b4e8-2800675231eb service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:44 user nova-compute[74820]: WARNING nova.compute.manager [req-0c31be9c-9fbd-44d1-94cb-b61a766c865c req-a7c8bef5-16b8-439a-b4e8-2800675231eb service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:43:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance destroyed successfully.
Nov 08 18:43:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-5cfef9cc-1c21-4bf6-b3ba-851bee44bcc0 req-220177c3-7be0-4492-aa81-a3bdda7aaf22 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5cfef9cc-1c21-4bf6-b3ba-851bee44bcc0 req-220177c3-7be0-4492-aa81-a3bdda7aaf22 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5cfef9cc-1c21-4bf6-b3ba-851bee44bcc0 req-220177c3-7be0-4492-aa81-a3bdda7aaf22 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5cfef9cc-1c21-4bf6-b3ba-851bee44bcc0 req-220177c3-7be0-4492-aa81-a3bdda7aaf22 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-5cfef9cc-1c21-4bf6-b3ba-851bee44bcc0 req-220177c3-7be0-4492-aa81-a3bdda7aaf22 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:46 user nova-compute[74820]: WARNING nova.compute.manager [req-5cfef9cc-1c21-4bf6-b3ba-851bee44bcc0 req-220177c3-7be0-4492-aa81-a3bdda7aaf22 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:43:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:48 user nova-compute[74820]: WARNING nova.compute.manager [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:43:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:43:48 user nova-compute[74820]: WARNING nova.compute.manager [req-ad94c206-545d-4ba4-b164-2845d752ef06 req-e8f3b2d4-00f0-47fd-941e-64ed941351da service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:43:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-004c4034-4b1f-498c-b69c-770cfe6cf843 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:43:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Going to confirm migration 2 {{(pid=74820) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 18:43:50 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 is timed out.
Nov 08 18:43:50 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully detached device vdb from instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 from the live domain config.
Nov 08 18:43:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mGyweTSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:43:50 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf715536-103b-4107-8947-f9f885b598d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:43:50 user nova-compute[74820]: No targets found.
Nov 08 18:43:50 user nova-compute[74820]: iSNS:
Nov 08 18:43:50 user nova-compute[74820]: No targets found.
Nov 08 18:43:50 user nova-compute[74820]: STATIC:
Nov 08 18:43:50 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802
Nov 08 18:43:50 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:43:50 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:43:50 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:43:50 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:43:50 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:43:50 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8
Nov 08 18:43:50 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:43:50 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:43:50 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a
Nov 08 18:43:50 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:43:50 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:43:50 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:43:50 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:43:50 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:43:50 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53
Nov 08 18:43:50 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:43:50 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:43:50 user nova-compute[74820]: FIRMWARE:
Nov 08 18:43:50 user nova-compute[74820]: No targets found.
Nov 08 18:43:50 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:43:50 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:43:50 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80613089-e802-4900-80b6-d5cc8bda4e56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3735806a-b169-486a-a097-29b98b4e98a3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:43:50 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a (non-flash)
Nov 08 18:43:50 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:43:50 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28269630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a'): ({'sdg'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Removing single pathed devices sdg {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23a9911-d446-4362-9348-1b7f1c38d362]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0edb431-08f8-427a-8abd-5768c41b1447]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Flushing IO for device /dev/sdg {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b4dba-e2e7-46d1-9e1c-1d371ae896b5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquired lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG nova.network.neutron [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'info_cache' on Instance uuid 86e06d0a-11c1-4e80-8592-b71f37124e6c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[439987ae-83cb-4981-8e7d-2a7aeeea83dd]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] SCSI volumes sdg have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d1dfa6-4591-41ef-8a3c-71748d5289ed]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --logout" returned: 0 in 0.131s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d444d38-b581-438f-b1ff-346a712093c8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260]
Nov 08 18:43:50 user nova-compute[74820]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a, portal: 172.16.0.220,3260] successful.
Nov 08 18:43:50 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:140bbc64-e0d5-4920-a786-65e68a2b540a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8583906a-b3ff-467f-94e0-5fa56e18dff6]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] <== disconnect_volume: return (504ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:43:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG nova.network.neutron [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [{"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Releasing lock "refresh_cache-86e06d0a-11c1-4e80-8592-b71f37124e6c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'migration_context' on Instance uuid 86e06d0a-11c1-4e80-8592-b71f37124e6c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG nova.objects.base [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Object Instance<86e06d0a-11c1-4e80-8592-b71f37124e6c> lazy-loaded attributes: info_cache,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.544s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG nova.objects.instance [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'flavor' on Instance uuid f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:43:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d291f00f-f41c-4a39-8d9c-8e1401d479a1 tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.754s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:52 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Deleted allocation for migration 091fea2f-841c-4961-baa6-fb72781a4577
Nov 08 18:43:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3c20984d-c691-402f-b8f3-9983bb6aba61 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.159s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:43:56 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:56 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:57 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:43:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:43:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:43:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:43:57 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:43:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:43:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:44:01 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=25.04330062866211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 470bcaa6-f884-45ff-b3cb-08aae76c808a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dbd0dc38-4495-451d-af1a-3c00bbcec5dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:44:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:44:02 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:44:02 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:44:02 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:44:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:44:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:44:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:44:04 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:44:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Updating instance_info_cache with network_info: [{"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:44:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-5ffeef93-63b0-4dab-a336-f2946b4cbae1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:44:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:44:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-changed-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Refreshing instance network info cache due to event network-changed-3c6fd632-330e-488f-880d-c606563be569. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] Acquiring lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] Acquired lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Refreshing network info cache for port 3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updated VIF entry in instance network info cache for port 3c6fd632-330e-488f-880d-c606563be569. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updating instance_info_cache with network_info: [{"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:44:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-73657e90-f68a-4562-aa87-5e33f7d979cd req-6f771f23-7a0a-4ad8-97f7-df536edf2d30 service nova] Releasing lock "refresh_cache-dbd0dc38-4495-451d-af1a-3c00bbcec5dc" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:10 user nova-compute[74820]: INFO nova.compute.manager [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Terminating instance
Nov 08 18:44:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-75212427-854b-4e1c-bc64-070a895cdff0 req-cd0d3989-bdee-4d4e-b3c0-07ee589588f8 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-vif-unplugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-75212427-854b-4e1c-bc64-070a895cdff0 req-cd0d3989-bdee-4d4e-b3c0-07ee589588f8 service nova] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-75212427-854b-4e1c-bc64-070a895cdff0 req-cd0d3989-bdee-4d4e-b3c0-07ee589588f8 service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-75212427-854b-4e1c-bc64-070a895cdff0 req-cd0d3989-bdee-4d4e-b3c0-07ee589588f8 service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-75212427-854b-4e1c-bc64-070a895cdff0 req-cd0d3989-bdee-4d4e-b3c0-07ee589588f8 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] No waiting events found dispatching network-vif-unplugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-75212427-854b-4e1c-bc64-070a895cdff0 req-cd0d3989-bdee-4d4e-b3c0-07ee589588f8 service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-vif-unplugged-3c6fd632-330e-488f-880d-c606563be569 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:44:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Instance destroyed successfully.
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.objects.instance [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'resources' on Instance uuid dbd0dc38-4495-451d-af1a-3c00bbcec5dc {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1947993487',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1947993487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1947993487',id=35,image_ref='1243e882-9b52-4a26-89e2-90b2a0fc8b3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTSanWDsHfZPV7xLzA1wXzyf7eiJwnvncVOVJ3mhYJ49HAn66FzQK8DPUhqVYMjkGrOigoWJgg1b84i1GWHIiHWeEnx0CA5Qi15l61eGxCNJU82aw7OjXQg3tDYw04clQ==',key_name='tempest-keypair-928541697',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:42:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-lj6hf7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1148056077',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=dbd0dc38-4495-451d-af1a-3c00bbcec5dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "3c6fd632-330e-488f-880d-c606563be569", "address": "fa:16:3e:af:91:36", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6fd632-33", "ovs_interfaceid": "3c6fd632-330e-488f-880d-c606563be569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_vif [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c6fd632-33, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a26d8f92-82c5-431e-a404-01b5bfb64158) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:11 user nova-compute[74820]: INFO os_vif [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:91:36,bridge_name='br-int',has_traffic_filtering=True,id=3c6fd632-330e-488f-880d-c606563be569,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c6fd632-33')
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SinwGmkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:44:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[26227ef9-9ab4-4bbe-81cc-ebaa6ebdddda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:44:11 user nova-compute[74820]: No targets found.
Nov 08 18:44:11 user nova-compute[74820]: iSNS:
Nov 08 18:44:11 user nova-compute[74820]: No targets found.
Nov 08 18:44:11 user nova-compute[74820]: STATIC:
Nov 08 18:44:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802
Nov 08 18:44:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:44:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:44:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:44:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:44:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:44:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8
Nov 08 18:44:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:44:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:44:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:44:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:44:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:44:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53
Nov 08 18:44:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:44:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:44:11 user nova-compute[74820]: FIRMWARE:
Nov 08 18:44:11 user nova-compute[74820]: No targets found.
Nov 08 18:44:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:44:11 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:44:11 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa72f7bc-5620-4147-9ae9-5d774db08a61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c82143d-0a8f-4abe-b1a4-c0b82988c013]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:44:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 (non-flash)
Nov 08 18:44:11 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:44:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2812fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53'): ({'sdf'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Removing single pathed devices sdf {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8997cb0-32c5-40a2-adc2-abb6d818c8e4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c935fbf9-86d0-4ce9-b0b7-1f04ef483182]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flushing IO for device /dev/sdf {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de58e7-76e0-4318-b7eb-e64f3830b9a9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8067e3e-b067-4eef-a650-2f49754a0d09]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO20ace188-b3156e24f8da5d20', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_20ace188', '/dev/disk/by-id/scsi-26233313536653234') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5424a67-aa50-4c9a-858e-ec07dbf3a43e]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[51587229-6377-40b7-9370-7565e91e10db]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747bcfe-bcad-465e-846e-42c8648b32a5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260]
Nov 08 18:44:11 user nova-compute[74820]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53, portal: 172.16.0.220,3260] successful.
Nov 08 18:44:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdce65-f319-41ef-b46c-5db4b2350e09]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== disconnect_volume: return (394ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:44:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:44:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Deleting instance files /opt/stack/data/nova/instances/dbd0dc38-4495-451d-af1a-3c00bbcec5dc_del
Nov 08 18:44:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Deletion of /opt/stack/data/nova/instances/dbd0dc38-4495-451d-af1a-3c00bbcec5dc_del complete
Nov 08 18:44:12 user nova-compute[74820]: INFO nova.compute.manager [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 08 18:44:12 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:44:12 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:44:12 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:44:13 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:44:13 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Took 1.09 seconds to deallocate network for instance.
Nov 08 18:44:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] Acquiring lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] No waiting events found dispatching network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:44:13 user nova-compute[74820]: WARNING nova.compute.manager [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received unexpected event network-vif-plugged-3c6fd632-330e-488f-880d-c606563be569 for instance with vm_state active and task_state deleting.
Nov 08 18:44:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-a59223de-6e41-4178-84dc-fc24b4481b57 req-415c7208-e320-41fd-b614-a9e620be694f service nova] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Received event network-vif-deleted-3c6fd632-330e-488f-880d-c606563be569 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:14 user nova-compute[74820]: INFO nova.compute.manager [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Took 1.17 seconds to detach 1 volumes for instance.
Nov 08 18:44:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dbd0dc38-4495-451d-af1a-3c00bbcec5dc] Deleting volume: ee04e7ca-dbec-4fbe-baa7-0b5fb793eb53 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 18:44:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:14 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:44:14 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:44:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:14 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Deleted allocations for instance dbd0dc38-4495-451d-af1a-3c00bbcec5dc
Nov 08 18:44:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-113d9e09-9982-4aeb-b9e7-341fc608869f tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dbd0dc38-4495-451d-af1a-3c00bbcec5dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.386s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:19 user nova-compute[74820]: INFO nova.compute.manager [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Terminating instance
Nov 08 18:44:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-fd9ac011-cacc-4233-9743-a25b095901f0 req-acda9070-3f2d-4948-b40b-67266c3e0cf2 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-vif-unplugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fd9ac011-cacc-4233-9743-a25b095901f0 req-acda9070-3f2d-4948-b40b-67266c3e0cf2 service nova] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fd9ac011-cacc-4233-9743-a25b095901f0 req-acda9070-3f2d-4948-b40b-67266c3e0cf2 service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fd9ac011-cacc-4233-9743-a25b095901f0 req-acda9070-3f2d-4948-b40b-67266c3e0cf2 service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-fd9ac011-cacc-4233-9743-a25b095901f0 req-acda9070-3f2d-4948-b40b-67266c3e0cf2 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] No waiting events found dispatching network-vif-unplugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:44:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-fd9ac011-cacc-4233-9743-a25b095901f0 req-acda9070-3f2d-4948-b40b-67266c3e0cf2 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-vif-unplugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:44:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Instance destroyed successfully.
Nov 08 18:44:20 user nova-compute[74820]: DEBUG nova.objects.instance [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lazy-loading 'resources' on Instance uuid f3ae0593-3d03-4b93-b444-6d5c4ef414c3 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1736974812',display_name='tempest-AttachVolumeNegativeTest-server-1736974812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1736974812',id=33,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK62dwNWdlDCbC+X+/XvzpKzJaMtgyjaaOfqTQCj7+dRAara903+hn8Ta8lenRYI2AWgT5DpxQmPLcmzliePtMyBJzwcZFZZ0OCPGQu0LM3GJNwV2XwgBO48eouW5zhRkw==',key_name='tempest-keypair-1220992648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4f45aa33327417986332546abed6d92',ramdisk_id='',reservation_id='r-xdehzq1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-657533753',owner_user_name='tempest-AttachVolumeNegativeTest-657533753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfee2b968614f47aa97aafd07b66548',uuid=f3ae0593-3d03-4b93-b444-6d5c4ef414c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converting VIF {"id": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "address": "fa:16:3e:13:06:66", "network": {"id": "6da192c1-fd68-488e-b7c0-51618eca66a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2014051675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4f45aa33327417986332546abed6d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5af42030-70", "ovs_interfaceid": "5af42030-70b7-4c1d-a37e-96f61319a9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG os_vif [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5af42030-70, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e223329b-8770-4f01-81fd-c2c24c7b1f0f) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:44:20 user nova-compute[74820]: INFO os_vif [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:66,bridge_name='br-int',has_traffic_filtering=True,id=5af42030-70b7-4c1d-a37e-96f61319a9c8,network=Network(6da192c1-fd68-488e-b7c0-51618eca66a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5af42030-70')
Nov 08 18:44:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Deleting instance files /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3_del
Nov 08 18:44:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Deletion of /opt/stack/data/nova/instances/f3ae0593-3d03-4b93-b444-6d5c4ef414c3_del complete
Nov 08 18:44:20 user nova-compute[74820]: INFO nova.compute.manager [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 18:44:20 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:44:20 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:44:21 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Took 0.75 seconds to deallocate network for instance.
Nov 08 18:44:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-2c91f5e6-ca8c-42ee-88ba-6ba01818f767 req-66d28c95-dd73-4297-a9f8-175e6fdc0045 service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-vif-deleted-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:21 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Deleted allocations for instance f3ae0593-3d03-4b93-b444-6d5c4ef414c3
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-98629b6b-1ca0-4c3a-a611-55715e6eb57b tempest-AttachVolumeNegativeTest-657533753 tempest-AttachVolumeNegativeTest-657533753-project-member] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-58836d4e-2623-4439-928f-c002d832973d req-5e52b315-60f3-45c5-a0da-95fcb6f571ad service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received event network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-58836d4e-2623-4439-928f-c002d832973d req-5e52b315-60f3-45c5-a0da-95fcb6f571ad service nova] Acquiring lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-58836d4e-2623-4439-928f-c002d832973d req-5e52b315-60f3-45c5-a0da-95fcb6f571ad service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-58836d4e-2623-4439-928f-c002d832973d req-5e52b315-60f3-45c5-a0da-95fcb6f571ad service nova] Lock "f3ae0593-3d03-4b93-b444-6d5c4ef414c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-58836d4e-2623-4439-928f-c002d832973d req-5e52b315-60f3-45c5-a0da-95fcb6f571ad service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] No waiting events found dispatching network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:44:21 user nova-compute[74820]: WARNING nova.compute.manager [req-58836d4e-2623-4439-928f-c002d832973d req-5e52b315-60f3-45c5-a0da-95fcb6f571ad service nova] [instance: f3ae0593-3d03-4b93-b444-6d5c4ef414c3] Received unexpected event network-vif-plugged-5af42030-70b7-4c1d-a37e-96f61319a9c8 for instance with vm_state deleted and task_state None.
Nov 08 18:44:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:44:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:44:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:44:42 user nova-compute[74820]: INFO nova.compute.claims [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Claim successful on node user
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:44:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.policy [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25fdaa58652e4b049dece86c8aebbc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a73996c12f04f31acffdc8bdf6f7220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:44:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Creating image(s)
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "/opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "/opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk 1073741824" returned: 0 in 0.058s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Successfully created port: 8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Cannot resize image /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Ensure instance console log exists: /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Successfully updated port: 8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquired lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-changed-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Refreshing instance network info cache due to event network-changed-8ea512b1-0249-480f-9cd0-ad94fb179788. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] Acquiring lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:44:44 user nova-compute[74820]: DEBUG nova.network.neutron [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updating instance_info_cache with network_info: [{"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Releasing lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Instance network_info: |[{"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] Acquired lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Refreshing network info cache for port 8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Start _get_guest_xml network_info=[{"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:44:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:44:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1308262',id=36,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUe+zTFV3bOQRnZlew2W8J3MT1/P5mxK8Dv1QxUSBmsX925HO2ee+aYYBQintp540DYNPixCh/rtAas3iuP/USJoZEF/MdHPT35UX9YnyvJ0JqwbB6GSJO1lBMz3jJiXw==',key_name='tempest-keypair-1851625159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a73996c12f04f31acffdc8bdf6f7220',ramdisk_id='',reservation_id='r-80rt007f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1351797380',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdaa58652e4b049dece86c8aebbc17',uuid=ccdcf88d-d416-46c8-b5f7-11bb8203bfbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Converting VIF {"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lazy-loading 'pci_devices' on Instance uuid ccdcf88d-d416-46c8-b5f7-11bb8203bfbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:44:45 user nova-compute[74820]:   <uuid>ccdcf88d-d416-46c8-b5f7-11bb8203bfbb</uuid>
Nov 08 18:44:45 user nova-compute[74820]:   <name>instance-00000024</name>
Nov 08 18:44:45 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:44:45 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:44:45 user nova-compute[74820]:   <metadata>
Nov 08 18:44:45 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:44:45 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:44:45 user nova-compute[74820]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396</nova:name>
Nov 08 18:44:45 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:44:45</nova:creationTime>
Nov 08 18:44:45 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:44:45 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:44:45 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:44:45 user nova-compute[74820]:       <nova:owner>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:user uuid="25fdaa58652e4b049dece86c8aebbc17">tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member</nova:user>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:project uuid="9a73996c12f04f31acffdc8bdf6f7220">tempest-TestServerVolumeAttachScenarioOldVersion-1351797380</nova:project>
Nov 08 18:44:45 user nova-compute[74820]:       </nova:owner>
Nov 08 18:44:45 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:44:45 user nova-compute[74820]:       <nova:ports>
Nov 08 18:44:45 user nova-compute[74820]:         <nova:port uuid="8ea512b1-0249-480f-9cd0-ad94fb179788">
Nov 08 18:44:45 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:44:45 user nova-compute[74820]:         </nova:port>
Nov 08 18:44:45 user nova-compute[74820]:       </nova:ports>
Nov 08 18:44:45 user nova-compute[74820]:     </nova:instance>
Nov 08 18:44:45 user nova-compute[74820]:   </metadata>
Nov 08 18:44:45 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:44:45 user nova-compute[74820]:     <system>
Nov 08 18:44:45 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:44:45 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:44:45 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:44:45 user nova-compute[74820]:       <entry name="serial">ccdcf88d-d416-46c8-b5f7-11bb8203bfbb</entry>
Nov 08 18:44:45 user nova-compute[74820]:       <entry name="uuid">ccdcf88d-d416-46c8-b5f7-11bb8203bfbb</entry>
Nov 08 18:44:45 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:44:45 user nova-compute[74820]:     </system>
Nov 08 18:44:45 user nova-compute[74820]:   </sysinfo>
Nov 08 18:44:45 user nova-compute[74820]:   <os>
Nov 08 18:44:45 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:44:45 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:44:45 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:44:45 user nova-compute[74820]:   </os>
Nov 08 18:44:45 user nova-compute[74820]:   <features>
Nov 08 18:44:45 user nova-compute[74820]:     <acpi/>
Nov 08 18:44:45 user nova-compute[74820]:     <apic/>
Nov 08 18:44:45 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:44:45 user nova-compute[74820]:   </features>
Nov 08 18:44:45 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:44:45 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:44:45 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:44:45 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:44:45 user nova-compute[74820]:   </clock>
Nov 08 18:44:45 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:44:45 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:44:45 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:44:45 user nova-compute[74820]:   </cpu>
Nov 08 18:44:45 user nova-compute[74820]:   <devices>
Nov 08 18:44:45 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:44:45 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:44:45 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk"/>
Nov 08 18:44:45 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:44:45 user nova-compute[74820]:     </disk>
Nov 08 18:44:45 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:44:45 user nova-compute[74820]:       <mac address="fa:16:3e:08:0d:48"/>
Nov 08 18:44:45 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:44:45 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:44:45 user nova-compute[74820]:       <target dev="tap8ea512b1-02"/>
Nov 08 18:44:45 user nova-compute[74820]:     </interface>
Nov 08 18:44:45 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:44:45 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/console.log" append="off"/>
Nov 08 18:44:45 user nova-compute[74820]:     </serial>
Nov 08 18:44:45 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:44:45 user nova-compute[74820]:     <video>
Nov 08 18:44:45 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:44:45 user nova-compute[74820]:     </video>
Nov 08 18:44:45 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:44:45 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:44:45 user nova-compute[74820]:     </rng>
Nov 08 18:44:45 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:44:45 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:44:45 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:44:45 user nova-compute[74820]:     </memballoon>
Nov 08 18:44:45 user nova-compute[74820]:   </devices>
Nov 08 18:44:45 user nova-compute[74820]: </domain>
Nov 08 18:44:45 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1308262',id=36,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUe+zTFV3bOQRnZlew2W8J3MT1/P5mxK8Dv1QxUSBmsX925HO2ee+aYYBQintp540DYNPixCh/rtAas3iuP/USJoZEF/MdHPT35UX9YnyvJ0JqwbB6GSJO1lBMz3jJiXw==',key_name='tempest-keypair-1851625159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a73996c12f04f31acffdc8bdf6f7220',ramdisk_id='',reservation_id='r-80rt007f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1351797380',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdaa58652e4b049dece86c8aebbc17',uuid=ccdcf88d-d416-46c8-b5f7-11bb8203bfbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Converting VIF {"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG os_vif [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3db7f58f-5ba2-54ca-a7a5-c041e8c3397d', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea512b1-02, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ea512b1-02, col_values=(('qos', UUID('3270a53c-2b7e-43f6-a9e0-e95a15376ba1')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ea512b1-02, col_values=(('external_ids', {'iface-id': '8ea512b1-0249-480f-9cd0-ad94fb179788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:0d:48', 'vm-uuid': 'ccdcf88d-d416-46c8-b5f7-11bb8203bfbb'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:45 user nova-compute[74820]: INFO os_vif [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02')
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] No VIF found with MAC fa:16:3e:08:0d:48, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updated VIF entry in instance network info cache for port 8ea512b1-0249-480f-9cd0-ad94fb179788. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updating instance_info_cache with network_info: [{"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:44:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cc03d94-6f34-4fcd-b264-25021710c720 req-4701ec6d-0d9b-455c-a057-43f72ebe724e service nova] Releasing lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-1dd3457c-3f37-47e7-8eb3-7f125af093a4 req-ff546231-179d-4d47-a196-2d53cba409f4 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1dd3457c-3f37-47e7-8eb3-7f125af093a4 req-ff546231-179d-4d47-a196-2d53cba409f4 service nova] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1dd3457c-3f37-47e7-8eb3-7f125af093a4 req-ff546231-179d-4d47-a196-2d53cba409f4 service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1dd3457c-3f37-47e7-8eb3-7f125af093a4 req-ff546231-179d-4d47-a196-2d53cba409f4 service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-1dd3457c-3f37-47e7-8eb3-7f125af093a4 req-ff546231-179d-4d47-a196-2d53cba409f4 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] No waiting events found dispatching network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:44:46 user nova-compute[74820]: WARNING nova.compute.manager [req-1dd3457c-3f37-47e7-8eb3-7f125af093a4 req-ff546231-179d-4d47-a196-2d53cba409f4 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received unexpected event network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 for instance with vm_state building and task_state spawning.
Nov 08 18:44:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:44:48 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Instance spawned successfully.
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-a340bb6f-77ea-48e5-a86d-b6696c65517c req-f89bb980-44ad-4613-8a78-158481f8bf9f service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a340bb6f-77ea-48e5-a86d-b6696c65517c req-f89bb980-44ad-4613-8a78-158481f8bf9f service nova] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a340bb6f-77ea-48e5-a86d-b6696c65517c req-f89bb980-44ad-4613-8a78-158481f8bf9f service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a340bb6f-77ea-48e5-a86d-b6696c65517c req-f89bb980-44ad-4613-8a78-158481f8bf9f service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-a340bb6f-77ea-48e5-a86d-b6696c65517c req-f89bb980-44ad-4613-8a78-158481f8bf9f service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] No waiting events found dispatching network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:44:48 user nova-compute[74820]: WARNING nova.compute.manager [req-a340bb6f-77ea-48e5-a86d-b6696c65517c req-f89bb980-44ad-4613-8a78-158481f8bf9f service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received unexpected event network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 for instance with vm_state building and task_state spawning.
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:44:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:44:49 user nova-compute[74820]: INFO nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 08 18:44:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:44:49 user nova-compute[74820]: INFO nova.compute.manager [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Took 6.21 seconds to build instance.
Nov 08 18:44:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-156ad50a-8bff-499a-992e-530a88b09077 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.320s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:44:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:44:56 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:44:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:44:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:44:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:44:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:03 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:45:03 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.056659698486328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 470bcaa6-f884-45ff-b3cb-08aae76c808a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:45:03 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:45:04 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:45:04 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:45:04 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:45:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:45:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:45:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:13 user nova-compute[74820]: INFO nova.compute.manager [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Terminating instance
Nov 08 18:45:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-598f16a5-5708-4258-91be-16063e5f97fc req-b0ef8719-4ac1-4ceb-919b-cbecfd3d7e17 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-vif-unplugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-598f16a5-5708-4258-91be-16063e5f97fc req-b0ef8719-4ac1-4ceb-919b-cbecfd3d7e17 service nova] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-598f16a5-5708-4258-91be-16063e5f97fc req-b0ef8719-4ac1-4ceb-919b-cbecfd3d7e17 service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-598f16a5-5708-4258-91be-16063e5f97fc req-b0ef8719-4ac1-4ceb-919b-cbecfd3d7e17 service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-598f16a5-5708-4258-91be-16063e5f97fc req-b0ef8719-4ac1-4ceb-919b-cbecfd3d7e17 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] No waiting events found dispatching network-vif-unplugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-598f16a5-5708-4258-91be-16063e5f97fc req-b0ef8719-4ac1-4ceb-919b-cbecfd3d7e17 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-vif-unplugged-0f4ed3b8-25d2-47be-ba55-a7183934daab for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:45:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Instance destroyed successfully.
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.objects.instance [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'resources' on Instance uuid c9b0f5f4-1d2a-476c-8a31-56f2e87b676e {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1810207759',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1810207759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1810207759',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCNp7+C0urhKQF7C46HH7koVvY+WMzFy/2NSAFcWG3E9E86T+qDorNHSJ42Wk7B2OtSL07qz15J9XjaYKlxWXMaxI2jLxGEMiI0FqWdzc9ghbxYoIzLrPWpk65tuOCD/Q==',key_name='tempest-keypair-18726973',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-7qtp91us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=c9b0f5f4-1d2a-476c-8a31-56f2e87b676e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "address": "fa:16:3e:2f:fd:a3", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ed3b8-25", "ovs_interfaceid": "0f4ed3b8-25d2-47be-ba55-a7183934daab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_vif [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f4ed3b8-25, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27d7fa39-f699-43fa-b254-54c7657a2343) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:14 user nova-compute[74820]: INFO os_vif [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=0f4ed3b8-25d2-47be-ba55-a7183934daab,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ed3b8-25')
Nov 08 18:45:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbONDzVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:45:14 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cdc581-1058-4f6a-b4f4-854c741a95f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:45:14 user nova-compute[74820]: No targets found.
Nov 08 18:45:14 user nova-compute[74820]: iSNS:
Nov 08 18:45:14 user nova-compute[74820]: No targets found.
Nov 08 18:45:14 user nova-compute[74820]: STATIC:
Nov 08 18:45:14 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802
Nov 08 18:45:14 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:14 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:14 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:45:14 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:14 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:14 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8
Nov 08 18:45:14 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:14 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:14 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:45:14 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:14 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:14 user nova-compute[74820]: FIRMWARE:
Nov 08 18:45:14 user nova-compute[74820]: No targets found.
Nov 08 18:45:14 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:45:14 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:45:14 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[168461cd-49f7-4f0d-9c98-82529a964038]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e3688-f983-489d-a952-a57b274ce325]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:45:14 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:45:14 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:45:14 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:45:14 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 (non-flash)
Nov 08 18:45:14 user nova-compute[74820]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:45:14 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:45:14 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:45:14 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28269510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ba58d2-0f14-44f4-b807-271d5d52c420]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a13d6-0534-496c-9235-babf2df159ca]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dc9daf-5de9-49fb-a712-7b58b5614845]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6687ee36-59d1-4128-b9e0-40065d8ac30a]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO783b8e3c-2e1a691dedc75d6a', '/dev/disk/by-id/scsi-23265316136393164', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_783b8e3c') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec906f42-2f98-4558-8ab8-6b4df46565b7]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5afa24-fc4f-4cb3-b9bc-8d9ab77b60f3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:45:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db1738-ea37-4559-95aa-619a67207ea5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260]
Nov 08 18:45:15 user nova-compute[74820]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802, portal: 172.16.0.220,3260] successful.
Nov 08 18:45:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4140489-5b48-4d1e-8b68-80cd23fa139c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== disconnect_volume: return (345ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:45:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Deleting instance files /opt/stack/data/nova/instances/c9b0f5f4-1d2a-476c-8a31-56f2e87b676e_del
Nov 08 18:45:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Deletion of /opt/stack/data/nova/instances/c9b0f5f4-1d2a-476c-8a31-56f2e87b676e_del complete
Nov 08 18:45:15 user nova-compute[74820]: INFO nova.compute.manager [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 08 18:45:15 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:45:15 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:45:16 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Took 0.93 seconds to deallocate network for instance.
Nov 08 18:45:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-d6709f70-e166-4718-9765-486cffa5bf2a req-c9c509ae-e11d-4d13-adc2-2245eef40533 service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-vif-deleted-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-941b5beb-c076-4c8b-b9af-272b6cf990e6 req-746221e9-0d91-485a-9202-1edcb49b9f2d service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received event network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-941b5beb-c076-4c8b-b9af-272b6cf990e6 req-746221e9-0d91-485a-9202-1edcb49b9f2d service nova] Acquiring lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-941b5beb-c076-4c8b-b9af-272b6cf990e6 req-746221e9-0d91-485a-9202-1edcb49b9f2d service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-941b5beb-c076-4c8b-b9af-272b6cf990e6 req-746221e9-0d91-485a-9202-1edcb49b9f2d service nova] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-941b5beb-c076-4c8b-b9af-272b6cf990e6 req-746221e9-0d91-485a-9202-1edcb49b9f2d service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] No waiting events found dispatching network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:16 user nova-compute[74820]: WARNING nova.compute.manager [req-941b5beb-c076-4c8b-b9af-272b6cf990e6 req-746221e9-0d91-485a-9202-1edcb49b9f2d service nova] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Received unexpected event network-vif-plugged-0f4ed3b8-25d2-47be-ba55-a7183934daab for instance with vm_state active and task_state deleting.
Nov 08 18:45:16 user nova-compute[74820]: INFO nova.compute.manager [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Unrescuing
Nov 08 18:45:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:45:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:45:17 user nova-compute[74820]: INFO nova.compute.manager [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Took 1.08 seconds to detach 1 volumes for instance.
Nov 08 18:45:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: c9b0f5f4-1d2a-476c-8a31-56f2e87b676e] Deleting volume: b4764dd7-4eb1-4743-b1f5-b9ac32bcf802 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:17 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Deleted allocations for instance c9b0f5f4-1d2a-476c-8a31-56f2e87b676e
Nov 08 18:45:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-11c253bc-c5be-4f94-962b-f8ee521decc3 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "c9b0f5f4-1d2a-476c-8a31-56f2e87b676e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.981s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'flavor' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:45:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-4424bc7c-ff6d-4d8f-bd2e-056046052b74 req-44798f2a-5cf2-4b67-9e85-263b36028a35 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4424bc7c-ff6d-4d8f-bd2e-056046052b74 req-44798f2a-5cf2-4b67-9e85-263b36028a35 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4424bc7c-ff6d-4d8f-bd2e-056046052b74 req-44798f2a-5cf2-4b67-9e85-263b36028a35 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4424bc7c-ff6d-4d8f-bd2e-056046052b74 req-44798f2a-5cf2-4b67-9e85-263b36028a35 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-4424bc7c-ff6d-4d8f-bd2e-056046052b74 req-44798f2a-5cf2-4b67-9e85-263b36028a35 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:18 user nova-compute[74820]: WARNING nova.compute.manager [req-4424bc7c-ff6d-4d8f-bd2e-056046052b74 req-44798f2a-5cf2-4b67-9e85-263b36028a35 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:45:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:18 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance destroyed successfully.
Nov 08 18:45:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:20 user nova-compute[74820]: WARNING nova.compute.manager [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:45:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:20 user nova-compute[74820]: WARNING nova.compute.manager [req-be819ad7-f1be-4c3a-864c-0320eff7e101 req-daac89c9-476b-4600-ac1d-960c4b051e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:45:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-7d8c5255-1447-4f0d-ad51-ad0793466aed req-a5489ebe-c0ef-4005-8a38-6505cce3b158 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7d8c5255-1447-4f0d-ad51-ad0793466aed req-a5489ebe-c0ef-4005-8a38-6505cce3b158 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7d8c5255-1447-4f0d-ad51-ad0793466aed req-a5489ebe-c0ef-4005-8a38-6505cce3b158 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7d8c5255-1447-4f0d-ad51-ad0793466aed req-a5489ebe-c0ef-4005-8a38-6505cce3b158 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-7d8c5255-1447-4f0d-ad51-ad0793466aed req-a5489ebe-c0ef-4005-8a38-6505cce3b158 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:22 user nova-compute[74820]: WARNING nova.compute.manager [req-7d8c5255-1447-4f0d-ad51-ad0793466aed req-a5489ebe-c0ef-4005-8a38-6505cce3b158 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:45:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a5fdae4a-3618-4e3e-b1d2-094732d3cc89 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:45:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:34 user nova-compute[74820]: INFO nova.compute.manager [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Terminating instance
Nov 08 18:45:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-17fade88-eac8-438e-8bae-83c0a2dff969 req-0db62fa0-2ee0-4a98-a3b0-f2fc5659ef31 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17fade88-eac8-438e-8bae-83c0a2dff969 req-0db62fa0-2ee0-4a98-a3b0-f2fc5659ef31 service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17fade88-eac8-438e-8bae-83c0a2dff969 req-0db62fa0-2ee0-4a98-a3b0-f2fc5659ef31 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17fade88-eac8-438e-8bae-83c0a2dff969 req-0db62fa0-2ee0-4a98-a3b0-f2fc5659ef31 service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-17fade88-eac8-438e-8bae-83c0a2dff969 req-0db62fa0-2ee0-4a98-a3b0-f2fc5659ef31 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-17fade88-eac8-438e-8bae-83c0a2dff969 req-0db62fa0-2ee0-4a98-a3b0-f2fc5659ef31 service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-unplugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Instance destroyed successfully.
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'resources' on Instance uuid 470bcaa6-f884-45ff-b3cb-08aae76c808a {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1296681237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1296681237',id=30,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-6715oa04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:43:49Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=470bcaa6-f884-45ff-b3cb-08aae76c808a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "address": "fa:16:3e:aa:aa:e6", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap678c07b1-4c", "ovs_interfaceid": "678c07b1-4c05-45b8-b2b8-b3aaff3d16ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_vif [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap678c07b1-4c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e97bb764-0447-4c93-9fc0-cb63335c769a) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:35 user nova-compute[74820]: INFO os_vif [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:aa:e6,bridge_name='br-int',has_traffic_filtering=True,id=678c07b1-4c05-45b8-b2b8-b3aaff3d16ee,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap678c07b1-4c')
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYTgEnwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:45:35 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66d33b6-f2c9-4d0f-9c38-2c26a150a40c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:45:35 user nova-compute[74820]: No targets found.
Nov 08 18:45:35 user nova-compute[74820]: iSNS:
Nov 08 18:45:35 user nova-compute[74820]: No targets found.
Nov 08 18:45:35 user nova-compute[74820]: STATIC:
Nov 08 18:45:35 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3
Nov 08 18:45:35 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:35 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:35 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8
Nov 08 18:45:35 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:35 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:35 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:45:35 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:45:35 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:45:35 user nova-compute[74820]: FIRMWARE:
Nov 08 18:45:35 user nova-compute[74820]: No targets found.
Nov 08 18:45:35 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:45:35 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:45:35 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ccfb04-432e-4a60-b340-a7bfdc31bb10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[289e004a-9abd-4f5f-b973-9b4a5cc0d780]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:45:35 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:45:35 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:45:35 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 (non-flash)
Nov 08 18:45:35 user nova-compute[74820]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:45:35 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:45:35 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2822dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fe8fdd-a90f-4d56-959d-9d00d1a884df]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[702dabaf-30cd-4ffd-a276-8e812d6f3956]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc9a090-3562-4469-be31-fe4042615d14]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b96c41f-419c-4650-842d-190f9fb706a7]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23865613733646461', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3726d205', '/dev/disk/by-id/scsi-1SCST_BIO3726d205-8ea73dda5ecdaa3b') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5751a1de-e26a-4d1f-9870-761fd41d93bb]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1964480d-700f-4422-8bff-57d8a3dbac7a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce698a-4fb3-4679-80f7-fe4a9be25253]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260]
Nov 08 18:45:35 user nova-compute[74820]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3, portal: 172.16.0.220,3260] successful.
Nov 08 18:45:35 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7ddf10-b446-484a-afa8-0c51c2e664c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f9133-f006-4aa6-b37a-43ca83f1d89f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== disconnect_volume: return (325ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:45:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Deleting instance files /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a_del
Nov 08 18:45:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Deletion of /opt/stack/data/nova/instances/470bcaa6-f884-45ff-b3cb-08aae76c808a_del complete
Nov 08 18:45:35 user nova-compute[74820]: INFO nova.compute.manager [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 18:45:35 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:45:35 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Took 0.51 seconds to deallocate network for instance.
Nov 08 18:45:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-8a8bb601-1dd4-4f68-9500-bb6ff586e6e5 req-67828461-c928-46f5-bcd3-17b03be0190b service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-deleted-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-9d90679a-4d65-4e3f-9303-58d130502146 req-9116003a-c9c6-4dc8-86f7-18f9f9e4e2aa service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:45:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9d90679a-4d65-4e3f-9303-58d130502146 req-9116003a-c9c6-4dc8-86f7-18f9f9e4e2aa service nova] Acquiring lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9d90679a-4d65-4e3f-9303-58d130502146 req-9116003a-c9c6-4dc8-86f7-18f9f9e4e2aa service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9d90679a-4d65-4e3f-9303-58d130502146 req-9116003a-c9c6-4dc8-86f7-18f9f9e4e2aa service nova] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-9d90679a-4d65-4e3f-9303-58d130502146 req-9116003a-c9c6-4dc8-86f7-18f9f9e4e2aa service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] No waiting events found dispatching network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:45:36 user nova-compute[74820]: WARNING nova.compute.manager [req-9d90679a-4d65-4e3f-9303-58d130502146 req-9116003a-c9c6-4dc8-86f7-18f9f9e4e2aa service nova] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Received unexpected event network-vif-plugged-678c07b1-4c05-45b8-b2b8-b3aaff3d16ee for instance with vm_state active and task_state deleting.
Nov 08 18:45:36 user nova-compute[74820]: INFO nova.compute.manager [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 470bcaa6-f884-45ff-b3cb-08aae76c808a] Took 0.97 seconds to detach 1 volumes for instance.
Nov 08 18:45:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:37 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:45:37 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:45:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:37 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Deleted allocations for instance 470bcaa6-f884-45ff-b3cb-08aae76c808a
Nov 08 18:45:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ae361033-ecd4-474c-83dc-e93d13ee7a11 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "470bcaa6-f884-45ff-b3cb-08aae76c808a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.386s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:41 user nova-compute[74820]: INFO nova.compute.manager [None req-85dc4d27-bad7-48be-bea0-ce8465922a41 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Get console output
Nov 08 18:45:41 user nova-compute[74820]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 18:45:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:45:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:45:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:45:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:45:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:45:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:45:59 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:04 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:46:04 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:46:04 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7903MB free_disk=24.441368103027344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:46:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 86e06d0a-11c1-4e80-8592-b71f37124e6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:46:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:46:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:46:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:46:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:46:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:46:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:46:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:46:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:46:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:46:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:46:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:46:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:46:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:46:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:46:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:25 user nova-compute[74820]: INFO nova.compute.manager [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Terminating instance
Nov 08 18:46:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-76599801-f802-412b-9f2e-3c11eb8ec3be req-093f1447-b6c7-4124-a2e2-1203603c3d7d service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-vif-unplugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-76599801-f802-412b-9f2e-3c11eb8ec3be req-093f1447-b6c7-4124-a2e2-1203603c3d7d service nova] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-76599801-f802-412b-9f2e-3c11eb8ec3be req-093f1447-b6c7-4124-a2e2-1203603c3d7d service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-76599801-f802-412b-9f2e-3c11eb8ec3be req-093f1447-b6c7-4124-a2e2-1203603c3d7d service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-76599801-f802-412b-9f2e-3c11eb8ec3be req-093f1447-b6c7-4124-a2e2-1203603c3d7d service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] No waiting events found dispatching network-vif-unplugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-76599801-f802-412b-9f2e-3c11eb8ec3be req-093f1447-b6c7-4124-a2e2-1203603c3d7d service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-vif-unplugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Instance destroyed successfully.
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.objects.instance [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'resources' on Instance uuid 5ffeef93-63b0-4dab-a336-f2946b4cbae1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:36:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1150862025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1150862025',id=23,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-yw7ej1op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:38:08Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=5ffeef93-63b0-4dab-a336-f2946b4cbae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "address": "fa:16:3e:b3:05:f4", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d35077a-01", "ovs_interfaceid": "7d35077a-01a8-483b-9fcc-0fc2e2af7bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG os_vif [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d35077a-01, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0336815b-1fd3-4350-8edd-5e559bc20c92) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:26 user nova-compute[74820]: INFO os_vif [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:05:f4,bridge_name='br-int',has_traffic_filtering=True,id=7d35077a-01a8-483b-9fcc-0fc2e2af7bec,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d35077a-01')
Nov 08 18:46:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Deleting instance files /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1_del
Nov 08 18:46:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Deletion of /opt/stack/data/nova/instances/5ffeef93-63b0-4dab-a336-f2946b4cbae1_del complete
Nov 08 18:46:26 user nova-compute[74820]: INFO nova.compute.manager [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 08 18:46:26 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:46:26 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Took 0.65 seconds to deallocate network for instance.
Nov 08 18:46:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-4a6f5acc-2d3d-43d7-8788-268797eee436 req-a4497c12-1378-4552-8b4c-dbf66d5da4c1 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-vif-deleted-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:27 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Deleted allocations for instance 5ffeef93-63b0-4dab-a336-f2946b4cbae1
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-cea73858-24d3-4e51-8c13-f0c7698d1f15 tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-1d6d202a-a7c4-4499-bf7c-86788450884e req-484e46ad-8826-493b-b832-db31efefcb62 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received event network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1d6d202a-a7c4-4499-bf7c-86788450884e req-484e46ad-8826-493b-b832-db31efefcb62 service nova] Acquiring lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1d6d202a-a7c4-4499-bf7c-86788450884e req-484e46ad-8826-493b-b832-db31efefcb62 service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1d6d202a-a7c4-4499-bf7c-86788450884e req-484e46ad-8826-493b-b832-db31efefcb62 service nova] Lock "5ffeef93-63b0-4dab-a336-f2946b4cbae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-1d6d202a-a7c4-4499-bf7c-86788450884e req-484e46ad-8826-493b-b832-db31efefcb62 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] No waiting events found dispatching network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:46:27 user nova-compute[74820]: WARNING nova.compute.manager [req-1d6d202a-a7c4-4499-bf7c-86788450884e req-484e46ad-8826-493b-b832-db31efefcb62 service nova] [instance: 5ffeef93-63b0-4dab-a336-f2946b4cbae1] Received unexpected event network-vif-plugged-7d35077a-01a8-483b-9fcc-0fc2e2af7bec for instance with vm_state deleted and task_state None.
Nov 08 18:46:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "467568ac-9c6b-4578-aff1-9fc28b093844" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:46:29 user nova-compute[74820]: INFO nova.compute.claims [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Claim successful on node user
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:46:29 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:46:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:46:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:46:30 user nova-compute[74820]: INFO nova.virt.block_device [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Booting with volume 3f683e58-9068-43fb-82a3-550a535c49ff at /dev/vda
Nov 08 18:46:30 user nova-compute[74820]: DEBUG nova.policy [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d80baca13c04f37b8ea3d651536cdfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ad38240d754655a8f23b1dbc581507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG os_brick.utils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa7b7c-47cd-41a9-94bc-9e272d2e5707]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[33df393c-9a2d-4bbc-a322-cf252e4e1bac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547e84e-0534-4507-824c-a99c31a4a4a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36ef90-aac1-42eb-a10a-15948bf0d8ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:46:30 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:46:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee96931-c61f-4675-9919-fecaf8e4bcd4]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG os_brick.utils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updating existing volume attachment record: 2e3dd99b-0b9b-472e-8667-6c8eb618f4ab {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:46:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Successfully created port: 44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Successfully updated port: 44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquired lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-changed-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Refreshing instance network info cache due to event network-changed-44387718-5b3b-42f6-9fff-6970516e6b5a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] Acquiring lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updating instance_info_cache with network_info: [{"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Releasing lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Instance network_info: |[{"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] Acquired lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:46:31 user nova-compute[74820]: DEBUG nova.network.neutron [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Refreshing network info cache for port 44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:46:32 user nova-compute[74820]: DEBUG nova.network.neutron [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updated VIF entry in instance network info cache for port 44387718-5b3b-42f6-9fff-6970516e6b5a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:46:32 user nova-compute[74820]: DEBUG nova.network.neutron [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updating instance_info_cache with network_info: [{"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:46:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-69ecadd2-4b7f-40cb-87a2-514fdce4cb8b req-d1318218-4c06-4b47-9930-6c863be9fdeb service nova] Releasing lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:46:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-changed-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Refreshing instance network info cache due to event network-changed-8ea512b1-0249-480f-9cd0-ad94fb179788. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:46:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] Acquiring lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:46:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] Acquired lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:46:33 user nova-compute[74820]: DEBUG nova.network.neutron [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Refreshing network info cache for port 8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:46:34 user nova-compute[74820]: DEBUG nova.network.neutron [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updated VIF entry in instance network info cache for port 8ea512b1-0249-480f-9cd0-ad94fb179788. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:46:34 user nova-compute[74820]: DEBUG nova.network.neutron [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updating instance_info_cache with network_info: [{"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:46:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1c6734c6-9b76-4a0f-8210-b22d2ea8a629 req-84578e43-757e-4988-a492-18cd4cce4c81 service nova] Releasing lock "refresh_cache-ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:46:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:46:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:42 user nova-compute[74820]: INFO nova.compute.manager [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Terminating instance
Nov 08 18:46:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-d593fea2-377f-4789-ba50-a6683f3dfda1 req-2266950c-8271-4b5e-b004-a97bc6a32638 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-unplugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d593fea2-377f-4789-ba50-a6683f3dfda1 req-2266950c-8271-4b5e-b004-a97bc6a32638 service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d593fea2-377f-4789-ba50-a6683f3dfda1 req-2266950c-8271-4b5e-b004-a97bc6a32638 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d593fea2-377f-4789-ba50-a6683f3dfda1 req-2266950c-8271-4b5e-b004-a97bc6a32638 service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-d593fea2-377f-4789-ba50-a6683f3dfda1 req-2266950c-8271-4b5e-b004-a97bc6a32638 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-unplugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-d593fea2-377f-4789-ba50-a6683f3dfda1 req-2266950c-8271-4b5e-b004-a97bc6a32638 service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-unplugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Instance destroyed successfully.
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.objects.instance [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'resources' on Instance uuid 86e06d0a-11c1-4e80-8592-b71f37124e6c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-506693465',display_name='tempest-ServerActionsTestOtherA-server-506693465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-506693465',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-yehjp0wz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=86e06d0a-11c1-4e80-8592-b71f37124e6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "address": "fa:16:3e:8f:84:ee", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9695cc5e-3d", "ovs_interfaceid": "9695cc5e-3d41-4296-80f2-1b5dbfd7192a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_vif [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9695cc5e-3d, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=502a9463-b430-40f3-95bb-359f16f0b928) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:46:43 user nova-compute[74820]: INFO os_vif [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:84:ee,bridge_name='br-int',has_traffic_filtering=True,id=9695cc5e-3d41-4296-80f2-1b5dbfd7192a,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9695cc5e-3d')
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWSIhZqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:46:43 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27709a4-2e92-452c-8d98-da509adbca6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:46:43 user nova-compute[74820]: No targets found.
Nov 08 18:46:43 user nova-compute[74820]: iSNS:
Nov 08 18:46:43 user nova-compute[74820]: No targets found.
Nov 08 18:46:43 user nova-compute[74820]: STATIC:
Nov 08 18:46:43 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8
Nov 08 18:46:43 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:46:43 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:46:43 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:46:43 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:46:43 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:46:43 user nova-compute[74820]: FIRMWARE:
Nov 08 18:46:43 user nova-compute[74820]: No targets found.
Nov 08 18:46:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:46:43 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:46:43 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af5a83-a092-44ee-9000-bdd3ea89f68c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab7c103-1522-4244-b293-6aaf356ac9c2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:46:43 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:46:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 (non-flash)
Nov 08 18:46:43 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:46:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e282eab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db01f4c-718e-40d7-be18-1788bbe7f52f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[393697b5-bca1-4f84-99b2-502225f83a07]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d296384e-2864-43b9-9d1c-db7fb2f02875]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5618132b-3d92-4222-a941-cc086cf1a157]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1fd73042-498e6dfac2374fab', '/dev/disk/by-id/scsi-23439386536646661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1fd73042') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbecea8c-ef42-4bf8-9ab8-cd54e857ee69]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bae5ef-16b7-42b0-bc95-5babab368b1a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ee9e4-36c3-441d-870b-9f1d787a3bd3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260]
Nov 08 18:46:43 user nova-compute[74820]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8, portal: 172.16.0.220,3260] successful.
Nov 08 18:46:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100ca020-7a2a-4d32-b938-a203dec6a8e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4cdb18-0b59-45f8-ad13-597e967b945a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] <== disconnect_volume: return (371ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:46:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Deleting instance files /opt/stack/data/nova/instances/86e06d0a-11c1-4e80-8592-b71f37124e6c_del
Nov 08 18:46:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Deletion of /opt/stack/data/nova/instances/86e06d0a-11c1-4e80-8592-b71f37124e6c_del complete
Nov 08 18:46:43 user nova-compute[74820]: INFO nova.compute.manager [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 08 18:46:43 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:46:43 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:46:44 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:46:44 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Took 0.93 seconds to deallocate network for instance.
Nov 08 18:46:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] Acquiring lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] No waiting events found dispatching network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:46:44 user nova-compute[74820]: WARNING nova.compute.manager [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received unexpected event network-vif-plugged-9695cc5e-3d41-4296-80f2-1b5dbfd7192a for instance with vm_state active and task_state deleting.
Nov 08 18:46:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-dd72bba6-05b2-4cfd-b77e-451b1fea7aaa req-2f1c2ba4-69d4-4f3f-8320-bf5ba86717aa service nova] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Received event network-vif-deleted-9695cc5e-3d41-4296-80f2-1b5dbfd7192a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lazy-loading 'flavor' on Instance uuid ccdcf88d-d416-46c8-b5f7-11bb8203bfbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:46:45 user nova-compute[74820]: INFO nova.compute.manager [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Attaching volume b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 to /dev/vdb
Nov 08 18:46:45 user nova-compute[74820]: DEBUG os_brick.utils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[573f200c-830c-47cd-9b73-a64b7335c070]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e14db9c-2aa8-407a-b690-82ff108a8989]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d3cad3-b73a-4a07-a956-245b58ad01f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04e61f-19be-4412-a060-072cd7031a05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:46:45 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:46:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e565d2e0-f796-4976-b19a-cee179e2cce0]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG os_brick.utils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:46:45 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updating existing volume attachment record: b8d08a76-ea06-408a-890e-eae9b9b9416a {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:46:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:46:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:56 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:46:56 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:46:57 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:46:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:46:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:46:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:01 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:47:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:03 user nova-compute[74820]: INFO nova.compute.manager [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Took 19.43 seconds to detach 1 volumes for instance.
Nov 08 18:47:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 86e06d0a-11c1-4e80-8592-b71f37124e6c] Deleting volume: 100ca020-7a2a-4d32-b938-a203dec6a8e8 {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:47:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Creating image(s)
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Ensure instance console log exists: /opt/stack/data/nova/instances/467568ac-9c6b-4578-aff1-9fc28b093844/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Start _get_guest_xml network_info=[{"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '2e3dd99b-0b9b-472e-8667-6c8eb618f4ab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '467568ac-9c6b-4578-aff1-9fc28b093844', 'attached_at': '', 'detached_at': '', 'volume_id': '3f683e58-9068-43fb-82a3-550a535c49ff', 'serial': '3f683e58-9068-43fb-82a3-550a535c49ff'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:47:04 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:04 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:47:04 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:47:04 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:47:04 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b86f55-b417-4cf0-9b1b-311c1c4e3608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:47:04 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5934f29-a97e-498b-84b7-e2a4bb1f614d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff] added
Nov 08 18:47:04 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:04 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6162cd2-4c20-4409-a735-a55f2ada8f58]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:05 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.121231079101562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.059s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dbdfee-2c38-41bb-ab37-d7cc86ddc078]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrJWgEvb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrJWgEvb" returned: 0 in 0.036s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df5cf4-eb48-4de8-bd9c-88ee711e58ce]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrJWgEvb'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b76f1-8e6e-408f-b327-e9f0960ef793]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b7a55c-3704-415b-8089-264328f8b40b]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.986s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b1c2dd-f6b8-48bd-827b-06e3239efd5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.245s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]
Nov 08 18:47:05 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.
Nov 08 18:47:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[543a05d4-e5fd-4ce0-bfe6-ebb8406f9836]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:05 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Deleted allocations for instance 86e06d0a-11c1-4e80-8592-b71f37124e6c
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f022a783-5067-499c-8d2a-115b1ec4e593]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:05 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:05 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.872s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1316f14-b0d7-4b7a-94cf-ad406d7c6b44]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3a96e438-f59b-48f9-badf-abf0baede2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c51df6e9-c969-4869-88be-77c877029dde actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 467568ac-9c6b-4578-aff1-9fc28b093844 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5bdc4176-d4cd-4abf-a1f1-b0254017b0d2 tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "86e06d0a-11c1-4e80-8592-b71f37124e6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.315s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:47:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.914s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== connect_volume: return (1915ms) {'type': 'block', 'scsi_wwn': '23239333137643930', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333137643930', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-54791576',display_name='tempest-TestVolumeBootPattern-server-54791576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-54791576',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-m3h152zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:46:30Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=467568ac-9c6b-4578-aff1-9fc28b093844,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.objects.instance [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'pci_devices' on Instance uuid 467568ac-9c6b-4578-aff1-9fc28b093844 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:47:06 user nova-compute[74820]:   <uuid>467568ac-9c6b-4578-aff1-9fc28b093844</uuid>
Nov 08 18:47:06 user nova-compute[74820]:   <name>instance-00000025</name>
Nov 08 18:47:06 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:47:06 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:47:06 user nova-compute[74820]:   <metadata>
Nov 08 18:47:06 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:47:06 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:47:06 user nova-compute[74820]:       <nova:name>tempest-TestVolumeBootPattern-server-54791576</nova:name>
Nov 08 18:47:06 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:47:04</nova:creationTime>
Nov 08 18:47:06 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:47:06 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:47:06 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:47:06 user nova-compute[74820]:       <nova:owner>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:user uuid="4d80baca13c04f37b8ea3d651536cdfd">tempest-TestVolumeBootPattern-1148056077-project-member</nova:user>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:project uuid="f2ad38240d754655a8f23b1dbc581507">tempest-TestVolumeBootPattern-1148056077</nova:project>
Nov 08 18:47:06 user nova-compute[74820]:       </nova:owner>
Nov 08 18:47:06 user nova-compute[74820]:       <nova:ports>
Nov 08 18:47:06 user nova-compute[74820]:         <nova:port uuid="44387718-5b3b-42f6-9fff-6970516e6b5a">
Nov 08 18:47:06 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:47:06 user nova-compute[74820]:         </nova:port>
Nov 08 18:47:06 user nova-compute[74820]:       </nova:ports>
Nov 08 18:47:06 user nova-compute[74820]:     </nova:instance>
Nov 08 18:47:06 user nova-compute[74820]:   </metadata>
Nov 08 18:47:06 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:47:06 user nova-compute[74820]:     <system>
Nov 08 18:47:06 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:47:06 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:47:06 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:47:06 user nova-compute[74820]:       <entry name="serial">467568ac-9c6b-4578-aff1-9fc28b093844</entry>
Nov 08 18:47:06 user nova-compute[74820]:       <entry name="uuid">467568ac-9c6b-4578-aff1-9fc28b093844</entry>
Nov 08 18:47:06 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:47:06 user nova-compute[74820]:     </system>
Nov 08 18:47:06 user nova-compute[74820]:   </sysinfo>
Nov 08 18:47:06 user nova-compute[74820]:   <os>
Nov 08 18:47:06 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:47:06 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:47:06 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:47:06 user nova-compute[74820]:   </os>
Nov 08 18:47:06 user nova-compute[74820]:   <features>
Nov 08 18:47:06 user nova-compute[74820]:     <acpi/>
Nov 08 18:47:06 user nova-compute[74820]:     <apic/>
Nov 08 18:47:06 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:47:06 user nova-compute[74820]:   </features>
Nov 08 18:47:06 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:47:06 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:47:06 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:47:06 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:47:06 user nova-compute[74820]:   </clock>
Nov 08 18:47:06 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:47:06 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:47:06 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:47:06 user nova-compute[74820]:   </cpu>
Nov 08 18:47:06 user nova-compute[74820]:   <devices>
Nov 08 18:47:06 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:47:06 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:47:06 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 18:47:06 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:47:06 user nova-compute[74820]:       <serial>3f683e58-9068-43fb-82a3-550a535c49ff</serial>
Nov 08 18:47:06 user nova-compute[74820]:     </disk>
Nov 08 18:47:06 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:47:06 user nova-compute[74820]:       <mac address="fa:16:3e:ac:cf:13"/>
Nov 08 18:47:06 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:06 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:47:06 user nova-compute[74820]:       <target dev="tap44387718-5b"/>
Nov 08 18:47:06 user nova-compute[74820]:     </interface>
Nov 08 18:47:06 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:47:06 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/467568ac-9c6b-4578-aff1-9fc28b093844/console.log" append="off"/>
Nov 08 18:47:06 user nova-compute[74820]:     </serial>
Nov 08 18:47:06 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:47:06 user nova-compute[74820]:     <video>
Nov 08 18:47:06 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:06 user nova-compute[74820]:     </video>
Nov 08 18:47:06 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:47:06 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:47:06 user nova-compute[74820]:     </rng>
Nov 08 18:47:06 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:47:06 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:47:06 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:47:06 user nova-compute[74820]:     </memballoon>
Nov 08 18:47:06 user nova-compute[74820]:   </devices>
Nov 08 18:47:06 user nova-compute[74820]: </domain>
Nov 08 18:47:06 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-54791576',display_name='tempest-TestVolumeBootPattern-server-54791576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-54791576',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-m3h152zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:46:30Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=467568ac-9c6b-4578-aff1-9fc28b093844,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG os_vif [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28beab52-649b-5020-927b-713b26e2df01', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44387718-5b, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44387718-5b, col_values=(('qos', UUID('684623d3-acc6-467b-9fff-4e619222fd6e')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44387718-5b, col_values=(('external_ids', {'iface-id': '44387718-5b3b-42f6-9fff-6970516e6b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:cf:13', 'vm-uuid': '467568ac-9c6b-4578-aff1-9fc28b093844'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:06 user nova-compute[74820]: INFO os_vif [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b')
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:47:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No VIF found with MAC fa:16:3e:ac:cf:13, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-0359d6c7-9df8-4ebf-8a9b-4d32afffc474 req-e7f67ffb-dbb4-4974-ac0e-00869df1ca17 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0359d6c7-9df8-4ebf-8a9b-4d32afffc474 req-e7f67ffb-dbb4-4974-ac0e-00869df1ca17 service nova] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0359d6c7-9df8-4ebf-8a9b-4d32afffc474 req-e7f67ffb-dbb4-4974-ac0e-00869df1ca17 service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0359d6c7-9df8-4ebf-8a9b-4d32afffc474 req-e7f67ffb-dbb4-4974-ac0e-00869df1ca17 service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-0359d6c7-9df8-4ebf-8a9b-4d32afffc474 req-e7f67ffb-dbb4-4974-ac0e-00869df1ca17 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] No waiting events found dispatching network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:08 user nova-compute[74820]: WARNING nova.compute.manager [req-0359d6c7-9df8-4ebf-8a9b-4d32afffc474 req-e7f67ffb-dbb4-4974-ac0e-00869df1ca17 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received unexpected event network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a for instance with vm_state building and task_state spawning.
Nov 08 18:47:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:47:08 user nova-compute[74820]: INFO nova.compute.claims [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Claim successful on node user
Nov 08 18:47:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:47:09 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.policy [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4206a1a856a413fb230bc83159a64e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3654d9e589554e51a0f7de7b13df6708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:47:09 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Creating image(s)
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "/opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "/opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "/opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.238s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk 1073741824" returned: 0 in 0.074s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-5098a7ea-3ba9-4227-b172-cdad39600e98 req-b1eb6751-4deb-43a8-b7b6-9ca5f8bc78f4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5098a7ea-3ba9-4227-b172-cdad39600e98 req-b1eb6751-4deb-43a8-b7b6-9ca5f8bc78f4 service nova] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5098a7ea-3ba9-4227-b172-cdad39600e98 req-b1eb6751-4deb-43a8-b7b6-9ca5f8bc78f4 service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5098a7ea-3ba9-4227-b172-cdad39600e98 req-b1eb6751-4deb-43a8-b7b6-9ca5f8bc78f4 service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-5098a7ea-3ba9-4227-b172-cdad39600e98 req-b1eb6751-4deb-43a8-b7b6-9ca5f8bc78f4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] No waiting events found dispatching network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:10 user nova-compute[74820]: WARNING nova.compute.manager [req-5098a7ea-3ba9-4227-b172-cdad39600e98 req-b1eb6751-4deb-43a8-b7b6-9ca5f8bc78f4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received unexpected event network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a for instance with vm_state building and task_state spawning.
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Successfully created port: fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Cannot resize image /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Ensure instance console log exists: /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:47:10 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Instance spawned successfully.
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:11 user nova-compute[74820]: INFO nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:47:11 user nova-compute[74820]: INFO nova.compute.manager [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Took 41.77 seconds to build instance.
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8fe0ee5d-1123-4d66-ad1f-5b49fc7eac5b tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "467568ac-9c6b-4578-aff1-9fc28b093844" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.900s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Successfully updated port: fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDmtCFMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:47:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:47:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:47:11 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquired lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-changed-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Refreshing instance network info cache due to event network-changed-fd47e57b-92ee-4a0b-ac68-b31b705229aa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] Acquiring lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8592d-303a-4371-8d1b-cffdde72993c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:47:11 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3c9ee-333f-4e97-824e-8ff3f92cf768]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4] added
Nov 08 18:47:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[af240952-2993-44a8-b55d-b19bc8e98392]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ac24ab-8f36-40fc-85d9-6a28ca2ee5b5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XDmtCFMT {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XDmtCFMT" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5181843a-d4bb-43eb-b4ef-419cf9264c4a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XDmtCFMT'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d37a06-7e04-4ac7-9311-fb0e7f895f67]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b727e48-a0f6-47ba-b9d6-f620ef254067]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.139s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[24affd72-941f-49b8-b99e-3c18d72e4725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260]
Nov 08 18:47:12 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260] successful.
Nov 08 18:47:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b35785f-755f-47a4-afb5-92db68f96a24]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating instance_info_cache with network_info: [{"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e4013-7852-49bd-8da6-cce3cd110410]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:12 user nova-compute[74820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)
Nov 08 18:47:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:12 user nova-compute[74820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)
Nov 08 18:47:12 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:12 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.492s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Releasing lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Instance network_info: |[{"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] Acquired lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Refreshing network info cache for port fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Start _get_guest_xml network_info=[{"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7ebca-6842-4fe3-91c3-9a79397a2039]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDmtCFMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:47:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1154119299',display_name='tempest-TestServerVolumeAttachmentScenario-server-1154119299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1154119299',id=38,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq+7XkImvtoQ8BcN4tT2x/PrzWq112tjMt0NcGpB+QJrj5kkPDW75QlE182wIoaSF+8XbCo/Iuyq5UE8meuLt+LinBWF58AJB4hKy81koteeivXRAhwnZpW9B6oUlchBw==',key_name='tempest-keypair-131043655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3654d9e589554e51a0f7de7b13df6708',ramdisk_id='',reservation_id='r-wrjs8dko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-755067306',owner_user_name='tempest-TestServerVolumeAttachmentScenario-755067306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4206a1a856a413fb230bc83159a64e0',uuid=929e541e-d426-4ef2-9c0c-1f077384e38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Converting VIF {"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'pci_devices' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:47:12 user nova-compute[74820]:   <uuid>929e541e-d426-4ef2-9c0c-1f077384e38c</uuid>
Nov 08 18:47:12 user nova-compute[74820]:   <name>instance-00000026</name>
Nov 08 18:47:12 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:47:12 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:47:12 user nova-compute[74820]:   <metadata>
Nov 08 18:47:12 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:47:12 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:47:12 user nova-compute[74820]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1154119299</nova:name>
Nov 08 18:47:12 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:47:12</nova:creationTime>
Nov 08 18:47:12 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:47:12 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:47:12 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:47:12 user nova-compute[74820]:       <nova:owner>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:user uuid="d4206a1a856a413fb230bc83159a64e0">tempest-TestServerVolumeAttachmentScenario-755067306-project-member</nova:user>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:project uuid="3654d9e589554e51a0f7de7b13df6708">tempest-TestServerVolumeAttachmentScenario-755067306</nova:project>
Nov 08 18:47:12 user nova-compute[74820]:       </nova:owner>
Nov 08 18:47:12 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:47:12 user nova-compute[74820]:       <nova:ports>
Nov 08 18:47:12 user nova-compute[74820]:         <nova:port uuid="fd47e57b-92ee-4a0b-ac68-b31b705229aa">
Nov 08 18:47:12 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:47:12 user nova-compute[74820]:         </nova:port>
Nov 08 18:47:12 user nova-compute[74820]:       </nova:ports>
Nov 08 18:47:12 user nova-compute[74820]:     </nova:instance>
Nov 08 18:47:12 user nova-compute[74820]:   </metadata>
Nov 08 18:47:12 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:47:12 user nova-compute[74820]:     <system>
Nov 08 18:47:12 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:47:12 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:47:12 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:47:12 user nova-compute[74820]:       <entry name="serial">929e541e-d426-4ef2-9c0c-1f077384e38c</entry>
Nov 08 18:47:12 user nova-compute[74820]:       <entry name="uuid">929e541e-d426-4ef2-9c0c-1f077384e38c</entry>
Nov 08 18:47:12 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:47:12 user nova-compute[74820]:     </system>
Nov 08 18:47:12 user nova-compute[74820]:   </sysinfo>
Nov 08 18:47:12 user nova-compute[74820]:   <os>
Nov 08 18:47:12 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:47:12 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:47:12 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:47:12 user nova-compute[74820]:   </os>
Nov 08 18:47:12 user nova-compute[74820]:   <features>
Nov 08 18:47:12 user nova-compute[74820]:     <acpi/>
Nov 08 18:47:12 user nova-compute[74820]:     <apic/>
Nov 08 18:47:12 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:47:12 user nova-compute[74820]:   </features>
Nov 08 18:47:12 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:47:12 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:47:12 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:47:12 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:47:12 user nova-compute[74820]:   </clock>
Nov 08 18:47:12 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:47:12 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:47:12 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:47:12 user nova-compute[74820]:   </cpu>
Nov 08 18:47:12 user nova-compute[74820]:   <devices>
Nov 08 18:47:12 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:47:12 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:47:12 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk"/>
Nov 08 18:47:12 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:47:12 user nova-compute[74820]:     </disk>
Nov 08 18:47:12 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:47:12 user nova-compute[74820]:       <mac address="fa:16:3e:38:92:87"/>
Nov 08 18:47:12 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:12 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:47:12 user nova-compute[74820]:       <target dev="tapfd47e57b-92"/>
Nov 08 18:47:12 user nova-compute[74820]:     </interface>
Nov 08 18:47:12 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:47:12 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/console.log" append="off"/>
Nov 08 18:47:12 user nova-compute[74820]:     </serial>
Nov 08 18:47:12 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:47:12 user nova-compute[74820]:     <video>
Nov 08 18:47:12 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:12 user nova-compute[74820]:     </video>
Nov 08 18:47:12 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:47:12 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:47:12 user nova-compute[74820]:     </rng>
Nov 08 18:47:12 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:47:12 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:47:12 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:47:12 user nova-compute[74820]:     </memballoon>
Nov 08 18:47:12 user nova-compute[74820]:   </devices>
Nov 08 18:47:12 user nova-compute[74820]: </domain>
Nov 08 18:47:12 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1154119299',display_name='tempest-TestServerVolumeAttachmentScenario-server-1154119299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1154119299',id=38,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq+7XkImvtoQ8BcN4tT2x/PrzWq112tjMt0NcGpB+QJrj5kkPDW75QlE182wIoaSF+8XbCo/Iuyq5UE8meuLt+LinBWF58AJB4hKy81koteeivXRAhwnZpW9B6oUlchBw==',key_name='tempest-keypair-131043655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3654d9e589554e51a0f7de7b13df6708',ramdisk_id='',reservation_id='r-wrjs8dko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-755067306',owner_user_name='tempest-TestServerVolumeAttachmentScenario-755067306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4206a1a856a413fb230bc83159a64e0',uuid=929e541e-d426-4ef2-9c0c-1f077384e38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Converting VIF {"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG os_vif [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3b9e5d3-313e-5f61-96d9-c3ca70a17bb0', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd47e57b-92, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd47e57b-92, col_values=(('qos', UUID('1be19ff0-3fce-484e-a2b7-5ab17d113591')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd47e57b-92, col_values=(('external_ids', {'iface-id': 'fd47e57b-92ee-4a0b-ac68-b31b705229aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:92:87', 'vm-uuid': '929e541e-d426-4ef2-9c0c-1f077384e38c'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:12 user nova-compute[74820]: INFO os_vif [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92')
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No VIF found with MAC fa:16:3e:38:92:87, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updated VIF entry in instance network info cache for port fd47e57b-92ee-4a0b-ac68-b31b705229aa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating instance_info_cache with network_info: [{"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-650e26bc-886e-4a47-87e2-524a61a7653e req-d5c4825c-933d-4174-9a9e-2e970d3f4399 service nova] Releasing lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:47:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.558s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:47:13 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] <== connect_volume: return (1561ms) {'type': 'block', 'scsi_wwn': '23038323063366164', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:47:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038323063366164', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:47:13 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lazy-loading 'flavor' on Instance uuid ccdcf88d-d416-46c8-b5f7-11bb8203bfbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:47:13 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:47:13 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:47:13 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:47:13 user nova-compute[74820]:   <serial>b2de7f27-ad5a-4305-9ad4-bd96cdff50d4</serial>
Nov 08 18:47:13 user nova-compute[74820]: </disk>
Nov 08 18:47:13 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:47:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] No VIF found with MAC fa:16:3e:08:0d:48, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7858ba40-643c-4a4b-8bb9-ada2e627e5ee tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.126s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-3908304d-b0df-4e32-819d-6143f886bfc4 req-6104eedd-c3b8-4927-a7e2-3d4e9efa5ddf service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3908304d-b0df-4e32-819d-6143f886bfc4 req-6104eedd-c3b8-4927-a7e2-3d4e9efa5ddf service nova] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3908304d-b0df-4e32-819d-6143f886bfc4 req-6104eedd-c3b8-4927-a7e2-3d4e9efa5ddf service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3908304d-b0df-4e32-819d-6143f886bfc4 req-6104eedd-c3b8-4927-a7e2-3d4e9efa5ddf service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-3908304d-b0df-4e32-819d-6143f886bfc4 req-6104eedd-c3b8-4927-a7e2-3d4e9efa5ddf service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] No waiting events found dispatching network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:14 user nova-compute[74820]: WARNING nova.compute.manager [req-3908304d-b0df-4e32-819d-6143f886bfc4 req-6104eedd-c3b8-4927-a7e2-3d4e9efa5ddf service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received unexpected event network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa for instance with vm_state building and task_state spawning.
Nov 08 18:47:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "c51df6e9-c969-4869-88be-77c877029dde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:16 user nova-compute[74820]: INFO nova.compute.manager [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Terminating instance
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-06b2f143-6f56-4792-a0c9-710a9dd58bef req-9987a1af-683e-4035-a191-70e748c5dc26 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-06b2f143-6f56-4792-a0c9-710a9dd58bef req-9987a1af-683e-4035-a191-70e748c5dc26 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-06b2f143-6f56-4792-a0c9-710a9dd58bef req-9987a1af-683e-4035-a191-70e748c5dc26 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-06b2f143-6f56-4792-a0c9-710a9dd58bef req-9987a1af-683e-4035-a191-70e748c5dc26 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-06b2f143-6f56-4792-a0c9-710a9dd58bef req-9987a1af-683e-4035-a191-70e748c5dc26 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-06b2f143-6f56-4792-a0c9-710a9dd58bef req-9987a1af-683e-4035-a191-70e748c5dc26 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-unplugged-b5562326-c480-40aa-80ab-db849577b104 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:47:16 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Instance destroyed successfully.
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'resources' on Instance uuid c51df6e9-c969-4869-88be-77c877029dde {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1281338095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1281338095',id=11,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:32:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-8sr3ipkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:34:24Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=c51df6e9-c969-4869-88be-77c877029dde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "b5562326-c480-40aa-80ab-db849577b104", "address": "fa:16:3e:62:44:0b", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5562326-c4", "ovs_interfaceid": "b5562326-c480-40aa-80ab-db849577b104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_vif [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5562326-c4, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ec0dda4-4b95-4399-9243-f2a32d3d6e58) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:16 user nova-compute[74820]: INFO os_vif [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:44:0b,bridge_name='br-int',has_traffic_filtering=True,id=b5562326-c480-40aa-80ab-db849577b104,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5562326-c4')
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQlnaZpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:47:16 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec361068-793c-42e2-b8a2-2da3531b692c req-02e769a7-1b95-4acf-9cf8-addda566b034 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec361068-793c-42e2-b8a2-2da3531b692c req-02e769a7-1b95-4acf-9cf8-addda566b034 service nova] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec361068-793c-42e2-b8a2-2da3531b692c req-02e769a7-1b95-4acf-9cf8-addda566b034 service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec361068-793c-42e2-b8a2-2da3531b692c req-02e769a7-1b95-4acf-9cf8-addda566b034 service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec361068-793c-42e2-b8a2-2da3531b692c req-02e769a7-1b95-4acf-9cf8-addda566b034 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] No waiting events found dispatching network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:16 user nova-compute[74820]: WARNING nova.compute.manager [req-ec361068-793c-42e2-b8a2-2da3531b692c req-02e769a7-1b95-4acf-9cf8-addda566b034 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received unexpected event network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa for instance with vm_state building and task_state spawning.
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88a7f4-92e1-4ca7-8fc8-9f014cffab04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:47:16 user nova-compute[74820]: No targets found.
Nov 08 18:47:16 user nova-compute[74820]: iSNS:
Nov 08 18:47:16 user nova-compute[74820]: No targets found.
Nov 08 18:47:16 user nova-compute[74820]: STATIC:
Nov 08 18:47:16 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:47:16 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:47:16 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:47:16 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4
Nov 08 18:47:16 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:47:16 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:47:16 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b
Nov 08 18:47:16 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:47:16 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:47:16 user nova-compute[74820]: FIRMWARE:
Nov 08 18:47:16 user nova-compute[74820]: No targets found.
Nov 08 18:47:16 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:47:16 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:47:16 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2d07a-5551-47f2-829c-f8404efb5c3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c89ac6b-2019-4da3-b3fe-607ab92e2bda]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:17 user nova-compute[74820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)
Nov 08 18:47:17 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:17 user nova-compute[74820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)
Nov 08 18:47:17 user nova-compute[74820]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b (non-flash)
Nov 08 18:47:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e282ebe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b'): ({'sdd'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Removing single pathed devices sdd {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[45277192-adfe-4816-a310-91f9be1f67bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad95d95-9079-4c5c-b9b3-f75aafec7127]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Flushing IO for device /dev/sdd {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[db12a211-3f61-463b-b604-c54a5baf3ab5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a3bb83-5626-4ac1-901a-4414e1772071]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] SCSI volumes sdd have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc379f6-4bde-4403-99b6-f28b1aa1a93b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bc2121-7dee-4757-94f7-c56f788a064a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260]
Nov 08 18:47:17 user nova-compute[74820]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b, portal: 172.16.0.220,3260] successful.
Nov 08 18:47:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:862b48d8-4df9-4c26-8fa4-e927ecac302b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81198d-f89f-4eba-b535-acb9c9fadcfc]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] <== disconnect_volume: return (375ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Deleting instance files /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde_del
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Deletion of /opt/stack/data/nova/instances/c51df6e9-c969-4869-88be-77c877029dde_del complete
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Instance spawned successfully.
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.compute.manager [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Took 7.85 seconds to spawn the instance on the hypervisor.
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.compute.manager [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Took 9.03 seconds to build instance.
Nov 08 18:47:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1b550558-6d3b-46f6-b6b7-dba2c6d7526d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.276s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:17 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:17 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: c51df6e9-c969-4869-88be-77c877029dde] Took 0.48 seconds to deallocate network for instance.
Nov 08 18:47:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:18 user nova-compute[74820]: INFO nova.compute.manager [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Detaching volume b2de7f27-ad5a-4305-9ad4-bd96cdff50d4
Nov 08 18:47:18 user nova-compute[74820]: INFO nova.virt.block_device [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Attempting to driver detach volume b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 from mountpoint /dev/vdb
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Attempting to detach device vdb from instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:47:18 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:47:18 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:47:18 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:47:18 user nova-compute[74820]:   <serial>b2de7f27-ad5a-4305-9ad4-bd96cdff50d4</serial>
Nov 08 18:47:18 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:47:18 user nova-compute[74820]: </disk>
Nov 08 18:47:18 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:47:18 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Successfully detached device vdb from instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb from the persistent domain config.
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:47:18 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:47:18 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:47:18 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:47:18 user nova-compute[74820]:   <serial>b2de7f27-ad5a-4305-9ad4-bd96cdff50d4</serial>
Nov 08 18:47:18 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:47:18 user nova-compute[74820]: </disk>
Nov 08 18:47:18 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] Acquiring lock "c51df6e9-c969-4869-88be-77c877029dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] Lock "c51df6e9-c969-4869-88be-77c877029dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] No waiting events found dispatching network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:18 user nova-compute[74820]: WARNING nova.compute.manager [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received unexpected event network-vif-plugged-b5562326-c480-40aa-80ab-db849577b104 for instance with vm_state active and task_state deleting.
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e1c40db1-2e52-43ba-8d23-317f7f101f40 req-a100038e-40aa-448f-a1b8-4bb65608ddd5 service nova] [instance: c51df6e9-c969-4869-88be-77c877029dde] Received event network-vif-deleted-b5562326-c480-40aa-80ab-db849577b104 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:47:19 user nova-compute[74820]: INFO nova.compute.manager [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: c51df6e9-c969-4869-88be-77c877029dde] Took 1.19 seconds to detach 1 volumes for instance.
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:47:19 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Deleted allocations for instance c51df6e9-c969-4869-88be-77c877029dde
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:47:19 user nova-compute[74820]: INFO nova.compute.claims [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Claim successful on node user
Nov 08 18:47:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f0a1d05d-7b5a-470d-b065-feeee772a19d tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "c51df6e9-c969-4869-88be-77c877029dde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.824s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:47:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.policy [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb2804c2bc374d52a2283e78f03959c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622d25fd48684d82bb673a57cf0a7928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:47:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Creating image(s)
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk 1073741824" returned: 0 in 0.053s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Successfully created port: 373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.204s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Cannot resize image /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Ensure instance console log exists: /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Successfully updated port: 373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing instance network info cache due to event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:47:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance network_info: |[{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Start _get_guest_xml network_info=[{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:47:22 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:22 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1000166135',display_name='tempest-ServerRescueNegativeTestJSON-server-1000166135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1000166135',id=39,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObls43yFDmntriYPy6vbwWi0RmZvBHXny0HYOK3pRItq3z1rlG6Zz73KuEt48wSci6nbmbg5zxD1doyPrGdbPkuOOwLGB+TzMcQJ9g25ZjDmylTGJDQCiNejiVF8PSLxQ==',key_name='tempest-keypair-867934815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-g2c7nad2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=e3910a1a-aa2b-4dfc-ace7-6928fb2654e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.objects.instance [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'pci_devices' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:47:22 user nova-compute[74820]:   <uuid>e3910a1a-aa2b-4dfc-ace7-6928fb2654e9</uuid>
Nov 08 18:47:22 user nova-compute[74820]:   <name>instance-00000027</name>
Nov 08 18:47:22 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:47:22 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:47:22 user nova-compute[74820]:   <metadata>
Nov 08 18:47:22 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:47:22 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:47:22 user nova-compute[74820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1000166135</nova:name>
Nov 08 18:47:22 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:47:22</nova:creationTime>
Nov 08 18:47:22 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:47:22 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:47:22 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:47:22 user nova-compute[74820]:       <nova:owner>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:user uuid="cb2804c2bc374d52a2283e78f03959c6">tempest-ServerRescueNegativeTestJSON-1619361117-project-member</nova:user>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:project uuid="622d25fd48684d82bb673a57cf0a7928">tempest-ServerRescueNegativeTestJSON-1619361117</nova:project>
Nov 08 18:47:22 user nova-compute[74820]:       </nova:owner>
Nov 08 18:47:22 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:47:22 user nova-compute[74820]:       <nova:ports>
Nov 08 18:47:22 user nova-compute[74820]:         <nova:port uuid="373a77bf-0cb5-4375-a9c6-0f884f430b7a">
Nov 08 18:47:22 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:47:22 user nova-compute[74820]:         </nova:port>
Nov 08 18:47:22 user nova-compute[74820]:       </nova:ports>
Nov 08 18:47:22 user nova-compute[74820]:     </nova:instance>
Nov 08 18:47:22 user nova-compute[74820]:   </metadata>
Nov 08 18:47:22 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:47:22 user nova-compute[74820]:     <system>
Nov 08 18:47:22 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:47:22 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:47:22 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:47:22 user nova-compute[74820]:       <entry name="serial">e3910a1a-aa2b-4dfc-ace7-6928fb2654e9</entry>
Nov 08 18:47:22 user nova-compute[74820]:       <entry name="uuid">e3910a1a-aa2b-4dfc-ace7-6928fb2654e9</entry>
Nov 08 18:47:22 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:47:22 user nova-compute[74820]:     </system>
Nov 08 18:47:22 user nova-compute[74820]:   </sysinfo>
Nov 08 18:47:22 user nova-compute[74820]:   <os>
Nov 08 18:47:22 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:47:22 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:47:22 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:47:22 user nova-compute[74820]:   </os>
Nov 08 18:47:22 user nova-compute[74820]:   <features>
Nov 08 18:47:22 user nova-compute[74820]:     <acpi/>
Nov 08 18:47:22 user nova-compute[74820]:     <apic/>
Nov 08 18:47:22 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:47:22 user nova-compute[74820]:   </features>
Nov 08 18:47:22 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:47:22 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:47:22 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:47:22 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:47:22 user nova-compute[74820]:   </clock>
Nov 08 18:47:22 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:47:22 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:47:22 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:47:22 user nova-compute[74820]:   </cpu>
Nov 08 18:47:22 user nova-compute[74820]:   <devices>
Nov 08 18:47:22 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:47:22 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:47:22 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk"/>
Nov 08 18:47:22 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:47:22 user nova-compute[74820]:     </disk>
Nov 08 18:47:22 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:47:22 user nova-compute[74820]:       <mac address="fa:16:3e:1c:9e:d2"/>
Nov 08 18:47:22 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:22 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:47:22 user nova-compute[74820]:       <target dev="tap373a77bf-0c"/>
Nov 08 18:47:22 user nova-compute[74820]:     </interface>
Nov 08 18:47:22 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:47:22 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/console.log" append="off"/>
Nov 08 18:47:22 user nova-compute[74820]:     </serial>
Nov 08 18:47:22 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:47:22 user nova-compute[74820]:     <video>
Nov 08 18:47:22 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:22 user nova-compute[74820]:     </video>
Nov 08 18:47:22 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:47:22 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:47:22 user nova-compute[74820]:     </rng>
Nov 08 18:47:22 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:47:22 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:47:22 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:47:22 user nova-compute[74820]:     </memballoon>
Nov 08 18:47:22 user nova-compute[74820]:   </devices>
Nov 08 18:47:22 user nova-compute[74820]: </domain>
Nov 08 18:47:22 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1000166135',display_name='tempest-ServerRescueNegativeTestJSON-server-1000166135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1000166135',id=39,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObls43yFDmntriYPy6vbwWi0RmZvBHXny0HYOK3pRItq3z1rlG6Zz73KuEt48wSci6nbmbg5zxD1doyPrGdbPkuOOwLGB+TzMcQJ9g25ZjDmylTGJDQCiNejiVF8PSLxQ==',key_name='tempest-keypair-867934815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-g2c7nad2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=e3910a1a-aa2b-4dfc-ace7-6928fb2654e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG os_vif [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09e29f34-eb2c-5dde-bdc1-138d3623ae24', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap373a77bf-0c, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap373a77bf-0c, col_values=(('qos', UUID('f583783f-2606-4b98-9f87-6185c294852c')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap373a77bf-0c, col_values=(('external_ids', {'iface-id': '373a77bf-0cb5-4375-a9c6-0f884f430b7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:9e:d2', 'vm-uuid': 'e3910a1a-aa2b-4dfc-ace7-6928fb2654e9'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:22 user nova-compute[74820]: INFO os_vif [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c')
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:1c:9e:d2, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updated VIF entry in instance network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef036d5d-2013-4eb2-8c64-99713cfa4b3b req-07ab05f0-7e76-4358-9861-88515fdeb92d service nova] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-b936eeae-1105-4d3b-99c6-1671b319138a req-80f0d45c-049d-4733-9a87-550277b108d5 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b936eeae-1105-4d3b-99c6-1671b319138a req-80f0d45c-049d-4733-9a87-550277b108d5 service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b936eeae-1105-4d3b-99c6-1671b319138a req-80f0d45c-049d-4733-9a87-550277b108d5 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b936eeae-1105-4d3b-99c6-1671b319138a req-80f0d45c-049d-4733-9a87-550277b108d5 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-b936eeae-1105-4d3b-99c6-1671b319138a req-80f0d45c-049d-4733-9a87-550277b108d5 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:24 user nova-compute[74820]: WARNING nova.compute.manager [req-b936eeae-1105-4d3b-99c6-1671b319138a req-80f0d45c-049d-4733-9a87-550277b108d5 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state building and task_state spawning.
Nov 08 18:47:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-28c46615-1f4e-4961-8bc1-b9e40abfed5d req-834f562e-a0d9-4f18-8755-73ed6a6b2085 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-28c46615-1f4e-4961-8bc1-b9e40abfed5d req-834f562e-a0d9-4f18-8755-73ed6a6b2085 service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-28c46615-1f4e-4961-8bc1-b9e40abfed5d req-834f562e-a0d9-4f18-8755-73ed6a6b2085 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-28c46615-1f4e-4961-8bc1-b9e40abfed5d req-834f562e-a0d9-4f18-8755-73ed6a6b2085 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-28c46615-1f4e-4961-8bc1-b9e40abfed5d req-834f562e-a0d9-4f18-8755-73ed6a6b2085 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:26 user nova-compute[74820]: WARNING nova.compute.manager [req-28c46615-1f4e-4961-8bc1-b9e40abfed5d req-834f562e-a0d9-4f18-8755-73ed6a6b2085 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state building and task_state spawning.
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:47:26 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance spawned successfully.
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:26 user nova-compute[74820]: INFO nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 08 18:47:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:47:26 user nova-compute[74820]: INFO nova.compute.manager [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Took 7.38 seconds to build instance.
Nov 08 18:47:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8045b93e-f987-4d5e-92ea-f8c4fd792e05 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.517s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb is timed out.
Nov 08 18:47:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Successfully detached device vdb from instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb from the live domain config.
Nov 08 18:47:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDmtCFMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:47:38 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6103e151-a405-4532-92b4-0ab0291208f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:47:38 user nova-compute[74820]: No targets found.
Nov 08 18:47:38 user nova-compute[74820]: iSNS:
Nov 08 18:47:38 user nova-compute[74820]: No targets found.
Nov 08 18:47:38 user nova-compute[74820]: STATIC:
Nov 08 18:47:38 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:47:38 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:47:38 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:47:38 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4
Nov 08 18:47:38 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:47:38 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:47:38 user nova-compute[74820]: FIRMWARE:
Nov 08 18:47:38 user nova-compute[74820]: No targets found.
Nov 08 18:47:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:47:38 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:47:38 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8910c1-a607-4a66-a8df-281856e9f563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a5a3fd-b8a2-4ed5-9d98-0f641a40cf2a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:38 user nova-compute[74820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)
Nov 08 18:47:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:47:38 user nova-compute[74820]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 (non-flash)
Nov 08 18:47:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e402bd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4dd24-783b-4260-aa51-f2fd6e7093c8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4540bdd-b71b-417b-b247-eccf747101a6]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1688b48-d84e-4b77-82f4-afe481c1382f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:47:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f096d-bf09-45fe-b4d4-05379543d433]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd37ae9-82cc-4521-bb7d-5f132305e037]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0832a59-b730-414c-8307-3d2887a0736e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260]
Nov 08 18:47:39 user nova-compute[74820]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4, portal: 172.16.0.220,3260] successful.
Nov 08 18:47:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2de7f27-ad5a-4305-9ad4-bd96cdff50d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9b0dec-d796-4e6c-8008-7dbd10507fce]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] <== disconnect_volume: return (361ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:47:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lazy-loading 'flavor' on Instance uuid ccdcf88d-d416-46c8-b5f7-11bb8203bfbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-316dbf16-c024-44c7-8512-24f7adaa0928 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.317s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:47:40 user nova-compute[74820]: INFO nova.compute.claims [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Claim successful on node user
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:47:41 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.policy [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01d3bbd5e6a44d5cb1d2c2b0991bc3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8744878c7583440e9f029d7d8228d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:47:41 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Creating image(s)
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "/opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "/opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "/opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk 1073741824" returned: 0 in 0.049s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.217s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Successfully created port: 818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Cannot resize image /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Ensure instance console log exists: /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Successfully updated port: 818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "refresh_cache-afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquired lock "refresh_cache-afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.compute.manager [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-changed-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.compute.manager [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Refreshing instance network info cache due to event network-changed-818f138e-1e69-48dd-bbb0-3e31c0c25061. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] Acquiring lock "refresh_cache-afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.neutron [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Updating instance_info_cache with network_info: [{"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Releasing lock "refresh_cache-afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Instance network_info: |[{"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] Acquired lock "refresh_cache-afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.neutron [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Refreshing network info cache for port 818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Start _get_guest_xml network_info=[{"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:47:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-953348812',display_name='tempest-VolumesNegativeTest-instance-953348812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-953348812',id=40,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8744878c7583440e9f029d7d8228d235',ramdisk_id='',reservation_id='r-nru7081s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2025496426',owner_user_name='tempest-VolumesNegativeTest-2025496426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:42Z,user_data=None,user_id='01d3bbd5e6a44d5cb1d2c2b0991bc3ba',uuid=afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Converting VIF {"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.objects.instance [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lazy-loading 'pci_devices' on Instance uuid afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:47:43 user nova-compute[74820]:   <uuid>afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7</uuid>
Nov 08 18:47:43 user nova-compute[74820]:   <name>instance-00000028</name>
Nov 08 18:47:43 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:47:43 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:47:43 user nova-compute[74820]:   <metadata>
Nov 08 18:47:43 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:47:43 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:47:43 user nova-compute[74820]:       <nova:name>tempest-VolumesNegativeTest-instance-953348812</nova:name>
Nov 08 18:47:43 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:47:43</nova:creationTime>
Nov 08 18:47:43 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:47:43 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:47:43 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:47:43 user nova-compute[74820]:       <nova:owner>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:user uuid="01d3bbd5e6a44d5cb1d2c2b0991bc3ba">tempest-VolumesNegativeTest-2025496426-project-member</nova:user>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:project uuid="8744878c7583440e9f029d7d8228d235">tempest-VolumesNegativeTest-2025496426</nova:project>
Nov 08 18:47:43 user nova-compute[74820]:       </nova:owner>
Nov 08 18:47:43 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:47:43 user nova-compute[74820]:       <nova:ports>
Nov 08 18:47:43 user nova-compute[74820]:         <nova:port uuid="818f138e-1e69-48dd-bbb0-3e31c0c25061">
Nov 08 18:47:43 user nova-compute[74820]:           <nova:ip type="fixed" address="192.168.233.203" ipVersion="4"/>
Nov 08 18:47:43 user nova-compute[74820]:         </nova:port>
Nov 08 18:47:43 user nova-compute[74820]:       </nova:ports>
Nov 08 18:47:43 user nova-compute[74820]:     </nova:instance>
Nov 08 18:47:43 user nova-compute[74820]:   </metadata>
Nov 08 18:47:43 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:47:43 user nova-compute[74820]:     <system>
Nov 08 18:47:43 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:47:43 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:47:43 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:47:43 user nova-compute[74820]:       <entry name="serial">afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7</entry>
Nov 08 18:47:43 user nova-compute[74820]:       <entry name="uuid">afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7</entry>
Nov 08 18:47:43 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:47:43 user nova-compute[74820]:     </system>
Nov 08 18:47:43 user nova-compute[74820]:   </sysinfo>
Nov 08 18:47:43 user nova-compute[74820]:   <os>
Nov 08 18:47:43 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:47:43 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:47:43 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:47:43 user nova-compute[74820]:   </os>
Nov 08 18:47:43 user nova-compute[74820]:   <features>
Nov 08 18:47:43 user nova-compute[74820]:     <acpi/>
Nov 08 18:47:43 user nova-compute[74820]:     <apic/>
Nov 08 18:47:43 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:47:43 user nova-compute[74820]:   </features>
Nov 08 18:47:43 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:47:43 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:47:43 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:47:43 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:47:43 user nova-compute[74820]:   </clock>
Nov 08 18:47:43 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:47:43 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:47:43 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:47:43 user nova-compute[74820]:   </cpu>
Nov 08 18:47:43 user nova-compute[74820]:   <devices>
Nov 08 18:47:43 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:47:43 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:47:43 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk"/>
Nov 08 18:47:43 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:47:43 user nova-compute[74820]:     </disk>
Nov 08 18:47:43 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:47:43 user nova-compute[74820]:       <mac address="fa:16:3e:71:c3:ea"/>
Nov 08 18:47:43 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:43 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:47:43 user nova-compute[74820]:       <target dev="tap818f138e-1e"/>
Nov 08 18:47:43 user nova-compute[74820]:     </interface>
Nov 08 18:47:43 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:47:43 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/console.log" append="off"/>
Nov 08 18:47:43 user nova-compute[74820]:     </serial>
Nov 08 18:47:43 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:47:43 user nova-compute[74820]:     <video>
Nov 08 18:47:43 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:47:43 user nova-compute[74820]:     </video>
Nov 08 18:47:43 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:47:43 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:47:43 user nova-compute[74820]:     </rng>
Nov 08 18:47:43 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:47:43 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:47:43 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:47:43 user nova-compute[74820]:     </memballoon>
Nov 08 18:47:43 user nova-compute[74820]:   </devices>
Nov 08 18:47:43 user nova-compute[74820]: </domain>
Nov 08 18:47:43 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-953348812',display_name='tempest-VolumesNegativeTest-instance-953348812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-953348812',id=40,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8744878c7583440e9f029d7d8228d235',ramdisk_id='',reservation_id='r-nru7081s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2025496426',owner_user_name='tempest-VolumesNegativeTest-2025496426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:42Z,user_data=None,user_id='01d3bbd5e6a44d5cb1d2c2b0991bc3ba',uuid=afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Converting VIF {"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG os_vif [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfdd9049-bc83-5543-b3f6-d570bf041ac1', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap818f138e-1e, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap818f138e-1e, col_values=(('qos', UUID('33d11847-8e2a-47ef-a025-aa444a84c0a1')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap818f138e-1e, col_values=(('external_ids', {'iface-id': '818f138e-1e69-48dd-bbb0-3e31c0c25061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:c3:ea', 'vm-uuid': 'afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:43 user nova-compute[74820]: INFO os_vif [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e')
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:47:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] No VIF found with MAC fa:16:3e:71:c3:ea, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:47:44 user nova-compute[74820]: DEBUG nova.network.neutron [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Updated VIF entry in instance network info cache for port 818f138e-1e69-48dd-bbb0-3e31c0c25061. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:47:44 user nova-compute[74820]: DEBUG nova.network.neutron [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Updating instance_info_cache with network_info: [{"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b7c19ac5-5469-47cd-a600-ca93f3f5e926 req-13c6d0e2-24f5-4875-a276-6c3ee56f0a54 service nova] Releasing lock "refresh_cache-afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-5025b7ff-7c31-43ef-9d6e-93ffdc0cbb53 req-c4af0971-f0a5-4fb4-b305-0db82f08806a service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5025b7ff-7c31-43ef-9d6e-93ffdc0cbb53 req-c4af0971-f0a5-4fb4-b305-0db82f08806a service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5025b7ff-7c31-43ef-9d6e-93ffdc0cbb53 req-c4af0971-f0a5-4fb4-b305-0db82f08806a service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5025b7ff-7c31-43ef-9d6e-93ffdc0cbb53 req-c4af0971-f0a5-4fb4-b305-0db82f08806a service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-5025b7ff-7c31-43ef-9d6e-93ffdc0cbb53 req-c4af0971-f0a5-4fb4-b305-0db82f08806a service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:45 user nova-compute[74820]: WARNING nova.compute.manager [req-5025b7ff-7c31-43ef-9d6e-93ffdc0cbb53 req-c4af0971-f0a5-4fb4-b305-0db82f08806a service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state building and task_state spawning.
Nov 08 18:47:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:47:47 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Instance spawned successfully.
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:47:47 user nova-compute[74820]: INFO nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:47:47 user nova-compute[74820]: INFO nova.compute.manager [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Took 7.01 seconds to build instance.
Nov 08 18:47:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-5d3a967e-3bca-46b6-9ddd-8dd8070915ec tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.128s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-4ca22fd8-bd8e-46a4-ad67-7ae2e332fff8 req-97912916-0d43-4b11-8f2d-d44250c176b0 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4ca22fd8-bd8e-46a4-ad67-7ae2e332fff8 req-97912916-0d43-4b11-8f2d-d44250c176b0 service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4ca22fd8-bd8e-46a4-ad67-7ae2e332fff8 req-97912916-0d43-4b11-8f2d-d44250c176b0 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4ca22fd8-bd8e-46a4-ad67-7ae2e332fff8 req-97912916-0d43-4b11-8f2d-d44250c176b0 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-4ca22fd8-bd8e-46a4-ad67-7ae2e332fff8 req-97912916-0d43-4b11-8f2d-d44250c176b0 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:47 user nova-compute[74820]: WARNING nova.compute.manager [req-4ca22fd8-bd8e-46a4-ad67-7ae2e332fff8 req-97912916-0d43-4b11-8f2d-d44250c176b0 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state active and task_state None.
Nov 08 18:47:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:53 user nova-compute[74820]: INFO nova.compute.manager [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Terminating instance
Nov 08 18:47:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-802e8a28-7132-43a4-a812-e6d333c815d9 req-17f5faa1-707d-4fb3-8591-bb2084d7333e service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-unplugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-802e8a28-7132-43a4-a812-e6d333c815d9 req-17f5faa1-707d-4fb3-8591-bb2084d7333e service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-802e8a28-7132-43a4-a812-e6d333c815d9 req-17f5faa1-707d-4fb3-8591-bb2084d7333e service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-802e8a28-7132-43a4-a812-e6d333c815d9 req-17f5faa1-707d-4fb3-8591-bb2084d7333e service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-802e8a28-7132-43a4-a812-e6d333c815d9 req-17f5faa1-707d-4fb3-8591-bb2084d7333e service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-unplugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-802e8a28-7132-43a4-a812-e6d333c815d9 req-17f5faa1-707d-4fb3-8591-bb2084d7333e service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-unplugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Instance destroyed successfully.
Nov 08 18:47:54 user nova-compute[74820]: DEBUG nova.objects.instance [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lazy-loading 'resources' on Instance uuid 3a96e438-f59b-48f9-badf-abf0baede2ee {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-768372607',display_name='tempest-ServerActionsTestOtherA-server-768372607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-768372607',id=2,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILHSZPeoE3Hqv3QM42nq29IQKSnjFf0DBpHP53JdC5Y6Z8dWNUek49bnRj0ehBY5mClF4InSGogOWf3rOdGWoRFqz0MTtcQX5EJUEmxR2x6s1AdXJrWCmOuFVf52MPOkw==',key_name='tempest-keypair-760528579',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cdef93b9fc745768902ae1afe39ae4a',ramdisk_id='',reservation_id='r-55br7gba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-600897548',owner_user_name='tempest-ServerActionsTestOtherA-600897548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a29988069fd43e0bfdb7b08a1fcc5d9',uuid=3a96e438-f59b-48f9-badf-abf0baede2ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converting VIF {"id": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "address": "fa:16:3e:6f:a4:63", "network": {"id": "ef35a180-3e88-41e0-b757-c1fd57da824d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1910714322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cdef93b9fc745768902ae1afe39ae4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d03043b-6d", "ovs_interfaceid": "5d03043b-6d05-4b75-beb0-4d59d95aeb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG os_vif [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d03043b-6d, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ddc1b53-8367-42ce-b94f-d2c7f0ea6989) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:47:54 user nova-compute[74820]: INFO os_vif [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=5d03043b-6d05-4b75-beb0-4d59d95aeb6b,network=Network(ef35a180-3e88-41e0-b757-c1fd57da824d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d03043b-6d')
Nov 08 18:47:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Deleting instance files /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee_del
Nov 08 18:47:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Deletion of /opt/stack/data/nova/instances/3a96e438-f59b-48f9-badf-abf0baede2ee_del complete
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: INFO nova.compute.manager [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 08 18:47:54 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:47:55 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Took 1.17 seconds to deallocate network for instance.
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:55 user nova-compute[74820]: WARNING nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received unexpected event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with vm_state deleted and task_state None.
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:55 user nova-compute[74820]: WARNING nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received unexpected event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with vm_state deleted and task_state None.
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:55 user nova-compute[74820]: WARNING nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received unexpected event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with vm_state deleted and task_state None.
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Acquiring lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] No waiting events found dispatching network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:47:55 user nova-compute[74820]: WARNING nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received unexpected event network-vif-plugged-5d03043b-6d05-4b75-beb0-4d59d95aeb6b for instance with vm_state deleted and task_state None.
Nov 08 18:47:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-59cfc420-2341-4895-9d8c-5dbc5f265692 req-e76f3961-6536-4fba-aa6d-1e0b8e075238 service nova] [instance: 3a96e438-f59b-48f9-badf-abf0baede2ee] Received event network-vif-deleted-5d03043b-6d05-4b75-beb0-4d59d95aeb6b {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:47:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:56 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Deleted allocations for instance 3a96e438-f59b-48f9-badf-abf0baede2ee
Nov 08 18:47:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-4b7c7df1-d3e2-43a4-bdeb-85fb7ba9a38c tempest-ServerActionsTestOtherA-600897548 tempest-ServerActionsTestOtherA-600897548-project-member] Lock "3a96e438-f59b-48f9-badf-abf0baede2ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.614s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:47:57 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:58 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:47:58 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:47:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:47:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:47:59 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:48:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:48:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:02 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:03 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:04 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:06 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:48:06 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:48:06 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=25.05154800415039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:48:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 467568ac-9c6b-4578-aff1-9fc28b093844 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 929e541e-d426-4ef2-9c0c-1f077384e38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:07 user nova-compute[74820]: INFO nova.compute.manager [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Terminating instance
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-af8fcb7b-5502-42b7-ba8c-6c1c55ac0317 req-647d50da-2118-40e4-8e19-9847ec4ab002 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-vif-unplugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-af8fcb7b-5502-42b7-ba8c-6c1c55ac0317 req-647d50da-2118-40e4-8e19-9847ec4ab002 service nova] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-af8fcb7b-5502-42b7-ba8c-6c1c55ac0317 req-647d50da-2118-40e4-8e19-9847ec4ab002 service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-af8fcb7b-5502-42b7-ba8c-6c1c55ac0317 req-647d50da-2118-40e4-8e19-9847ec4ab002 service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-af8fcb7b-5502-42b7-ba8c-6c1c55ac0317 req-647d50da-2118-40e4-8e19-9847ec4ab002 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] No waiting events found dispatching network-vif-unplugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-af8fcb7b-5502-42b7-ba8c-6c1c55ac0317 req-647d50da-2118-40e4-8e19-9847ec4ab002 service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-vif-unplugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.904s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Instance destroyed successfully.
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lazy-loading 'resources' on Instance uuid 3cbcbe67-7c9c-46a8-8617-85921d7fb83f {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1644669325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1644669325',id=1,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e77a76c049904c6abe35b10929563c00',ramdisk_id='',reservation_id='r-uwqjhdqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-516881030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:28:43Z,user_data=None,user_id='c5790613f8a24f52897aedd0634f7f7f',uuid=3cbcbe67-7c9c-46a8-8617-85921d7fb83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converting VIF {"id": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "address": "fa:16:3e:2b:07:48", "network": {"id": "ba969f57-c4fa-43bd-a80d-1a95d46e6b4b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1354336284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e77a76c049904c6abe35b10929563c00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d64d0e5-09", "ovs_interfaceid": "6d64d0e5-098d-417c-873e-d2dcc1f57287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG os_vif [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d64d0e5-09, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8528cb0-2f5e-4b75-90de-5d76231d48f8) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:07 user nova-compute[74820]: INFO os_vif [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:07:48,bridge_name='br-int',has_traffic_filtering=True,id=6d64d0e5-098d-417c-873e-d2dcc1f57287,network=Network(ba969f57-c4fa-43bd-a80d-1a95d46e6b4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d64d0e5-09')
Nov 08 18:48:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Deleting instance files /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f_del
Nov 08 18:48:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Deletion of /opt/stack/data/nova/instances/3cbcbe67-7c9c-46a8-8617-85921d7fb83f_del complete
Nov 08 18:48:07 user nova-compute[74820]: INFO nova.compute.manager [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 08 18:48:07 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:48:07 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:48:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:08 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:48:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-30c5c531-e470-4147-b7a5-895ecd30e2a0 req-a1beaf3b-9b1e-4692-b623-bdc4a9b7713a service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-vif-deleted-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:08 user nova-compute[74820]: INFO nova.compute.manager [req-30c5c531-e470-4147-b7a5-895ecd30e2a0 req-a1beaf3b-9b1e-4692-b623-bdc4a9b7713a service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Neutron deleted interface 6d64d0e5-098d-417c-873e-d2dcc1f57287; detaching it from the instance and deleting it from the info cache
Nov 08 18:48:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-30c5c531-e470-4147-b7a5-895ecd30e2a0 req-a1beaf3b-9b1e-4692-b623-bdc4a9b7713a service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:48:08 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Took 0.75 seconds to deallocate network for instance.
Nov 08 18:48:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-30c5c531-e470-4147-b7a5-895ecd30e2a0 req-a1beaf3b-9b1e-4692-b623-bdc4a9b7713a service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Detach interface failed, port_id=6d64d0e5-098d-417c-873e-d2dcc1f57287, reason: Instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:48:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:08 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:09 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Deleted allocations for instance 3cbcbe67-7c9c-46a8-8617-85921d7fb83f
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3f757864-9791-4c50-818d-59c248150dbe tempest-ServerBootFromVolumeStableRescueTest-516881030 tempest-ServerBootFromVolumeStableRescueTest-516881030-project-member] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-55932960-f91a-4048-8254-5251b5f662a1 req-c2bb2f86-1979-43bd-aab8-15ee9593a1af service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received event network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-55932960-f91a-4048-8254-5251b5f662a1 req-c2bb2f86-1979-43bd-aab8-15ee9593a1af service nova] Acquiring lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-55932960-f91a-4048-8254-5251b5f662a1 req-c2bb2f86-1979-43bd-aab8-15ee9593a1af service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-55932960-f91a-4048-8254-5251b5f662a1 req-c2bb2f86-1979-43bd-aab8-15ee9593a1af service nova] Lock "3cbcbe67-7c9c-46a8-8617-85921d7fb83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-55932960-f91a-4048-8254-5251b5f662a1 req-c2bb2f86-1979-43bd-aab8-15ee9593a1af service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] No waiting events found dispatching network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:48:09 user nova-compute[74820]: WARNING nova.compute.manager [req-55932960-f91a-4048-8254-5251b5f662a1 req-c2bb2f86-1979-43bd-aab8-15ee9593a1af service nova] [instance: 3cbcbe67-7c9c-46a8-8617-85921d7fb83f] Received unexpected event network-vif-plugged-6d64d0e5-098d-417c-873e-d2dcc1f57287 for instance with vm_state deleted and task_state None.
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:48:09 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:48:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:48:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:48:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:48:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:19 user nova-compute[74820]: INFO nova.compute.manager [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Terminating instance
Nov 08 18:48:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Instance destroyed successfully.
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lazy-loading 'resources' on Instance uuid ccdcf88d-d416-46c8-b5f7-11bb8203bfbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1308262396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1308262',id=36,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUe+zTFV3bOQRnZlew2W8J3MT1/P5mxK8Dv1QxUSBmsX925HO2ee+aYYBQintp540DYNPixCh/rtAas3iuP/USJoZEF/MdHPT35UX9YnyvJ0JqwbB6GSJO1lBMz3jJiXw==',key_name='tempest-keypair-1851625159',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a73996c12f04f31acffdc8bdf6f7220',ramdisk_id='',reservation_id='r-80rt007f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1351797380',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25fdaa58652e4b049dece86c8aebbc17',uuid=ccdcf88d-d416-46c8-b5f7-11bb8203bfbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Converting VIF {"id": "8ea512b1-0249-480f-9cd0-ad94fb179788", "address": "fa:16:3e:08:0d:48", "network": {"id": "d12217f7-00b7-47c8-800b-cfe45ca84185", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1747219819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a73996c12f04f31acffdc8bdf6f7220", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea512b1-02", "ovs_interfaceid": "8ea512b1-0249-480f-9cd0-ad94fb179788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG os_vif [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea512b1-02, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3270a53c-2b7e-43f6-a9e0-e95a15376ba1) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:48:20 user nova-compute[74820]: INFO os_vif [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:0d:48,bridge_name='br-int',has_traffic_filtering=True,id=8ea512b1-0249-480f-9cd0-ad94fb179788,network=Network(d12217f7-00b7-47c8-800b-cfe45ca84185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea512b1-02')
Nov 08 18:48:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Deleting instance files /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb_del
Nov 08 18:48:20 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Deletion of /opt/stack/data/nova/instances/ccdcf88d-d416-46c8-b5f7-11bb8203bfbb_del complete
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-731aec34-ebe7-4b15-8b43-bbfc40db426f req-1462c461-846f-4358-9c7e-9d8260e708ea service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-vif-unplugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-731aec34-ebe7-4b15-8b43-bbfc40db426f req-1462c461-846f-4358-9c7e-9d8260e708ea service nova] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-731aec34-ebe7-4b15-8b43-bbfc40db426f req-1462c461-846f-4358-9c7e-9d8260e708ea service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-731aec34-ebe7-4b15-8b43-bbfc40db426f req-1462c461-846f-4358-9c7e-9d8260e708ea service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-731aec34-ebe7-4b15-8b43-bbfc40db426f req-1462c461-846f-4358-9c7e-9d8260e708ea service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] No waiting events found dispatching network-vif-unplugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-731aec34-ebe7-4b15-8b43-bbfc40db426f req-1462c461-846f-4358-9c7e-9d8260e708ea service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-vif-unplugged-8ea512b1-0249-480f-9cd0-ad94fb179788 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:48:20 user nova-compute[74820]: INFO nova.compute.manager [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 18:48:20 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:48:20 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:48:21 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:48:21 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Took 1.37 seconds to deallocate network for instance.
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:22 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Deleted allocations for instance ccdcf88d-d416-46c8-b5f7-11bb8203bfbb
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e0490622-04b8-440a-9e11-3c958b6dcf82 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380 tempest-TestServerVolumeAttachScenarioOldVersion-1351797380-project-member] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] Acquiring lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] Lock "ccdcf88d-d416-46c8-b5f7-11bb8203bfbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] No waiting events found dispatching network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:48:22 user nova-compute[74820]: WARNING nova.compute.manager [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received unexpected event network-vif-plugged-8ea512b1-0249-480f-9cd0-ad94fb179788 for instance with vm_state deleted and task_state None.
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-5fca9786-7404-444a-a225-eca5caacb952 req-67325a99-2f26-42b7-aeaf-16cb6cbc0847 service nova] [instance: ccdcf88d-d416-46c8-b5f7-11bb8203bfbb] Received event network-vif-deleted-8ea512b1-0249-480f-9cd0-ad94fb179788 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-changed-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.compute.manager [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Refreshing instance network info cache due to event network-changed-44387718-5b3b-42f6-9fff-6970516e6b5a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] Acquiring lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] Acquired lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:48:22 user nova-compute[74820]: DEBUG nova.network.neutron [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Refreshing network info cache for port 44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updated VIF entry in instance network info cache for port 44387718-5b3b-42f6-9fff-6970516e6b5a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updating instance_info_cache with network_info: [{"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a0f77a46-b9ae-40a5-8e29-76d7b2a8f33b req-21d22fc5-9e79-41f8-8596-93d2302e35e4 service nova] Releasing lock "refresh_cache-467568ac-9c6b-4578-aff1-9fc28b093844" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "467568ac-9c6b-4578-aff1-9fc28b093844" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:23 user nova-compute[74820]: INFO nova.compute.manager [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Terminating instance
Nov 08 18:48:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-96aa1707-5b59-4f3d-8f71-1c1b7930db89 req-5951c993-a3b4-4247-bbcb-617e5023c3e7 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-vif-unplugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96aa1707-5b59-4f3d-8f71-1c1b7930db89 req-5951c993-a3b4-4247-bbcb-617e5023c3e7 service nova] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96aa1707-5b59-4f3d-8f71-1c1b7930db89 req-5951c993-a3b4-4247-bbcb-617e5023c3e7 service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-96aa1707-5b59-4f3d-8f71-1c1b7930db89 req-5951c993-a3b4-4247-bbcb-617e5023c3e7 service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-96aa1707-5b59-4f3d-8f71-1c1b7930db89 req-5951c993-a3b4-4247-bbcb-617e5023c3e7 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] No waiting events found dispatching network-vif-unplugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:48:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-96aa1707-5b59-4f3d-8f71-1c1b7930db89 req-5951c993-a3b4-4247-bbcb-617e5023c3e7 service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-vif-unplugged-44387718-5b3b-42f6-9fff-6970516e6b5a for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:48:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Instance destroyed successfully.
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'resources' on Instance uuid 467568ac-9c6b-4578-aff1-9fc28b093844 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-54791576',display_name='tempest-TestVolumeBootPattern-server-54791576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-54791576',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-m3h152zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:47:11Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=467568ac-9c6b-4578-aff1-9fc28b093844,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "44387718-5b3b-42f6-9fff-6970516e6b5a", "address": "fa:16:3e:ac:cf:13", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44387718-5b", "ovs_interfaceid": "44387718-5b3b-42f6-9fff-6970516e6b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_vif [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44387718-5b, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=684623d3-acc6-467b-9fff-4e619222fd6e) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:24 user nova-compute[74820]: INFO os_vif [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:13,bridge_name='br-int',has_traffic_filtering=True,id=44387718-5b3b-42f6-9fff-6970516e6b5a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44387718-5b')
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:48:24 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4431803-4f25-46aa-aaf7-bc7426da6e2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:48:24 user nova-compute[74820]: No targets found.
Nov 08 18:48:24 user nova-compute[74820]: iSNS:
Nov 08 18:48:24 user nova-compute[74820]: No targets found.
Nov 08 18:48:24 user nova-compute[74820]: STATIC:
Nov 08 18:48:24 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:48:24 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:48:24 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:48:24 user nova-compute[74820]: FIRMWARE:
Nov 08 18:48:24 user nova-compute[74820]: No targets found.
Nov 08 18:48:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:48:24 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:48:24 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf03a7-acc3-4866-ad33-cf7a96e9d1b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36449be-b84c-46c9-8f71-e5a187e9c0a9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:48:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:48:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e401ecd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcb142d-9997-4e83-a0d3-1876e3e16e55]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ba6d1-17da-44bd-ab60-8646e09c1b89]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9eed20-fa07-41ad-b16e-1e7b744dce65]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ecf35-32c5-4a78-a5ea-b37f0adf496d]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bd120d1a', '/dev/disk/by-id/scsi-1SCST_BIObd120d1a-29317d90d178d098', '/dev/disk/by-id/scsi-23239333137643930') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8303410f-888a-4b41-891a-6827b7e8eaf5]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbca3f89-bcb6-4803-b7a1-f4a116140ab5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b143855-cbf5-45c6-8034-473e5d400a7d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]
Nov 08 18:48:24 user nova-compute[74820]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.
Nov 08 18:48:24 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2b1eb1-a3b5-4783-b40f-dc017fd5fc78]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== disconnect_volume: return (332ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:48:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Deleting instance files /opt/stack/data/nova/instances/467568ac-9c6b-4578-aff1-9fc28b093844_del
Nov 08 18:48:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Deletion of /opt/stack/data/nova/instances/467568ac-9c6b-4578-aff1-9fc28b093844_del complete
Nov 08 18:48:24 user nova-compute[74820]: INFO nova.compute.manager [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 08 18:48:24 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:48:24 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:48:25 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:48:25 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Took 0.82 seconds to deallocate network for instance.
Nov 08 18:48:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-6301445b-c615-4f86-a0e6-a4cf23bb5fbe req-029dd892-f300-46cd-965d-46155523330b service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-vif-deleted-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-17785746-3785-49f1-b598-701a0d015d28 req-29ee2bb1-5dea-431b-a863-2e5e45509d0d service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received event network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:48:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17785746-3785-49f1-b598-701a0d015d28 req-29ee2bb1-5dea-431b-a863-2e5e45509d0d service nova] Acquiring lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17785746-3785-49f1-b598-701a0d015d28 req-29ee2bb1-5dea-431b-a863-2e5e45509d0d service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-17785746-3785-49f1-b598-701a0d015d28 req-29ee2bb1-5dea-431b-a863-2e5e45509d0d service nova] Lock "467568ac-9c6b-4578-aff1-9fc28b093844-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-17785746-3785-49f1-b598-701a0d015d28 req-29ee2bb1-5dea-431b-a863-2e5e45509d0d service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] No waiting events found dispatching network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:48:25 user nova-compute[74820]: WARNING nova.compute.manager [req-17785746-3785-49f1-b598-701a0d015d28 req-29ee2bb1-5dea-431b-a863-2e5e45509d0d service nova] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Received unexpected event network-vif-plugged-44387718-5b3b-42f6-9fff-6970516e6b5a for instance with vm_state active and task_state deleting.
Nov 08 18:48:26 user nova-compute[74820]: INFO nova.compute.manager [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 467568ac-9c6b-4578-aff1-9fc28b093844] Took 0.95 seconds to detach 1 volumes for instance.
Nov 08 18:48:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:26 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:48:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:48:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:26 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Deleted allocations for instance 467568ac-9c6b-4578-aff1-9fc28b093844
Nov 08 18:48:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-750e37c5-ea76-4e0c-ab69-bb8c86b3e84a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "467568ac-9c6b-4578-aff1-9fc28b093844" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.415s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:48:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:48:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:48:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:48 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:48:59 user nova-compute[74820]: INFO nova.compute.claims [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Claim successful on node user
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:48:59 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:49:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:49:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Creating image(s)
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.policy [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7487b21f1a7d456a879d0911ff2b8b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6dbf427cb540cda851042887350b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-changed-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Refreshing instance network info cache due to event network-changed-fd47e57b-92ee-4a0b-ac68-b31b705229aa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] Acquiring lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] Acquired lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG nova.network.neutron [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Refreshing network info cache for port fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk 1073741824" returned: 0 in 0.060s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Cannot resize image /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Ensure instance console log exists: /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Successfully created port: 3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.objects.instance [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'flavor' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:01 user nova-compute[74820]: INFO nova.compute.manager [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attaching volume 11ac29c7-164d-4c9e-a1a6-8a554e2bf458 to /dev/vdb
Nov 08 18:49:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f925d8cb-3bcc-43a1-8f98-f3c7afdcf94d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4417b76-e857-4b2b-981e-ef9b67cb712c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbba6c-0a07-416d-9700-3aa3307d6632]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d203882-344f-42b2-96cf-3d5561134636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:01 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:49:01 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb25bbe2-ee2a-47bc-9922-e37f5ce8ed9c]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG os_brick.utils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating existing volume attachment record: 5bee6c08-f052-4afa-af61-f4950da57695 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updated VIF entry in instance network info cache for port fd47e57b-92ee-4a0b-ac68-b31b705229aa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:49:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating instance_info_cache with network_info: [{"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9c4402ff-68a1-4e3d-9a18-487a996f00a2 req-8e1ecbcd-5996-4eb6-9388-9610fadc87c9 service nova] Releasing lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Successfully updated port: 3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing instance network info cache due to event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.neutron [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance network_info: |[{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.neutron [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Start _get_guest_xml network_info=[{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:49:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:49:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1420271536',display_name='tempest-ServerStableDeviceRescueTest-server-1420271536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1420271536',id=41,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM48eOi6v215srLN0TaqER5lRThokE6vti/AYowdlQxrwjHvAkaWKxfp+gH7Q25LzcqmiSFzRM2hIi6SdO7U0kWFfGvjRUPCqvLepecHDyaouFOMz+vfmyQ//+3+L1cvRA==',key_name='tempest-keypair-976236889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d6dbf427cb540cda851042887350b47',ramdisk_id='',reservation_id='r-rf62ozlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1586196320',owner_user_name='tempest-ServerStableDeviceRescueTest-1586196320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7487b21f1a7d456a879d0911ff2b8b7e',uuid=2543db51-ac21-4c92-8df1-d8c31b93ddbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converting VIF {"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'pci_devices' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:49:02 user nova-compute[74820]:   <uuid>2543db51-ac21-4c92-8df1-d8c31b93ddbb</uuid>
Nov 08 18:49:02 user nova-compute[74820]:   <name>instance-00000029</name>
Nov 08 18:49:02 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:49:02 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:49:02 user nova-compute[74820]:   <metadata>
Nov 08 18:49:02 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:49:02 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:49:02 user nova-compute[74820]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1420271536</nova:name>
Nov 08 18:49:02 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:49:02</nova:creationTime>
Nov 08 18:49:02 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:49:02 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:49:02 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:49:02 user nova-compute[74820]:       <nova:owner>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:user uuid="7487b21f1a7d456a879d0911ff2b8b7e">tempest-ServerStableDeviceRescueTest-1586196320-project-member</nova:user>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:project uuid="3d6dbf427cb540cda851042887350b47">tempest-ServerStableDeviceRescueTest-1586196320</nova:project>
Nov 08 18:49:02 user nova-compute[74820]:       </nova:owner>
Nov 08 18:49:02 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:49:02 user nova-compute[74820]:       <nova:ports>
Nov 08 18:49:02 user nova-compute[74820]:         <nova:port uuid="3dd86d48-7b4f-4784-b80f-84e4f214f982">
Nov 08 18:49:02 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:49:02 user nova-compute[74820]:         </nova:port>
Nov 08 18:49:02 user nova-compute[74820]:       </nova:ports>
Nov 08 18:49:02 user nova-compute[74820]:     </nova:instance>
Nov 08 18:49:02 user nova-compute[74820]:   </metadata>
Nov 08 18:49:02 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:49:02 user nova-compute[74820]:     <system>
Nov 08 18:49:02 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:49:02 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:49:02 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:49:02 user nova-compute[74820]:       <entry name="serial">2543db51-ac21-4c92-8df1-d8c31b93ddbb</entry>
Nov 08 18:49:02 user nova-compute[74820]:       <entry name="uuid">2543db51-ac21-4c92-8df1-d8c31b93ddbb</entry>
Nov 08 18:49:02 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:49:02 user nova-compute[74820]:     </system>
Nov 08 18:49:02 user nova-compute[74820]:   </sysinfo>
Nov 08 18:49:02 user nova-compute[74820]:   <os>
Nov 08 18:49:02 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:49:02 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:49:02 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:49:02 user nova-compute[74820]:   </os>
Nov 08 18:49:02 user nova-compute[74820]:   <features>
Nov 08 18:49:02 user nova-compute[74820]:     <acpi/>
Nov 08 18:49:02 user nova-compute[74820]:     <apic/>
Nov 08 18:49:02 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:49:02 user nova-compute[74820]:   </features>
Nov 08 18:49:02 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:49:02 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:49:02 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:49:02 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:49:02 user nova-compute[74820]:   </clock>
Nov 08 18:49:02 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:49:02 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:49:02 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:49:02 user nova-compute[74820]:   </cpu>
Nov 08 18:49:02 user nova-compute[74820]:   <devices>
Nov 08 18:49:02 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:49:02 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:49:02 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk"/>
Nov 08 18:49:02 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:49:02 user nova-compute[74820]:     </disk>
Nov 08 18:49:02 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:49:02 user nova-compute[74820]:       <mac address="fa:16:3e:e2:24:d1"/>
Nov 08 18:49:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:49:02 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:49:02 user nova-compute[74820]:       <target dev="tap3dd86d48-7b"/>
Nov 08 18:49:02 user nova-compute[74820]:     </interface>
Nov 08 18:49:02 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:49:02 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/console.log" append="off"/>
Nov 08 18:49:02 user nova-compute[74820]:     </serial>
Nov 08 18:49:02 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:49:02 user nova-compute[74820]:     <video>
Nov 08 18:49:02 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:49:02 user nova-compute[74820]:     </video>
Nov 08 18:49:02 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:49:02 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:49:02 user nova-compute[74820]:     </rng>
Nov 08 18:49:02 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:49:02 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:49:02 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:49:02 user nova-compute[74820]:     </memballoon>
Nov 08 18:49:02 user nova-compute[74820]:   </devices>
Nov 08 18:49:02 user nova-compute[74820]: </domain>
Nov 08 18:49:02 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1420271536',display_name='tempest-ServerStableDeviceRescueTest-server-1420271536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1420271536',id=41,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM48eOi6v215srLN0TaqER5lRThokE6vti/AYowdlQxrwjHvAkaWKxfp+gH7Q25LzcqmiSFzRM2hIi6SdO7U0kWFfGvjRUPCqvLepecHDyaouFOMz+vfmyQ//+3+L1cvRA==',key_name='tempest-keypair-976236889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d6dbf427cb540cda851042887350b47',ramdisk_id='',reservation_id='r-rf62ozlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1586196320',owner_user_name='tempest-ServerStableDeviceRescueTest-1586196320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7487b21f1a7d456a879d0911ff2b8b7e',uuid=2543db51-ac21-4c92-8df1-d8c31b93ddbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converting VIF {"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG os_vif [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91450bfb-dd5f-59e1-89fa-760338ea2e2d', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd86d48-7b, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dd86d48-7b, col_values=(('qos', UUID('9fca149b-c3f7-4619-82f7-04fe68324851')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dd86d48-7b, col_values=(('external_ids', {'iface-id': '3dd86d48-7b4f-4784-b80f-84e4f214f982', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:24:d1', 'vm-uuid': '2543db51-ac21-4c92-8df1-d8c31b93ddbb'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:49:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:02 user nova-compute[74820]: INFO os_vif [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b')
Nov 08 18:49:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:49:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No VIF found with MAC fa:16:3e:e2:24:d1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:49:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updated VIF entry in instance network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b3adb9b4-4009-479d-a8c6-554ca932acfa req-41b22bda-212d-4d19-906b-c8a65897df9a service nova] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-3d83da46-3b31-41ef-a919-04302ad0c819 req-137485c9-84cf-4b88-acd1-b998fc341694 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3d83da46-3b31-41ef-a919-04302ad0c819 req-137485c9-84cf-4b88-acd1-b998fc341694 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3d83da46-3b31-41ef-a919-04302ad0c819 req-137485c9-84cf-4b88-acd1-b998fc341694 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3d83da46-3b31-41ef-a919-04302ad0c819 req-137485c9-84cf-4b88-acd1-b998fc341694 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-3d83da46-3b31-41ef-a919-04302ad0c819 req-137485c9-84cf-4b88-acd1-b998fc341694 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:04 user nova-compute[74820]: WARNING nova.compute.manager [req-3d83da46-3b31-41ef-a919-04302ad0c819 req-137485c9-84cf-4b88-acd1-b998fc341694 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state building and task_state spawning.
Nov 08 18:49:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:49:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-80440a66-53a2-4510-91c8-411c7106cd42 req-04d0a14c-ccb9-4dc1-b9ed-7d0d94b0d301 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-80440a66-53a2-4510-91c8-411c7106cd42 req-04d0a14c-ccb9-4dc1-b9ed-7d0d94b0d301 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-80440a66-53a2-4510-91c8-411c7106cd42 req-04d0a14c-ccb9-4dc1-b9ed-7d0d94b0d301 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-80440a66-53a2-4510-91c8-411c7106cd42 req-04d0a14c-ccb9-4dc1-b9ed-7d0d94b0d301 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-80440a66-53a2-4510-91c8-411c7106cd42 req-04d0a14c-ccb9-4dc1-b9ed-7d0d94b0d301 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:06 user nova-compute[74820]: WARNING nova.compute.manager [req-80440a66-53a2-4510-91c8-411c7106cd42 req-04d0a14c-ccb9-4dc1-b9ed-7d0d94b0d301 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state building and task_state spawning.
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:49:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:49:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance spawned successfully.
Nov 08 18:49:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:07 user nova-compute[74820]: INFO nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 08 18:49:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:07 user nova-compute[74820]: INFO nova.compute.manager [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Took 7.75 seconds to build instance.
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e6582c56-be7c-4a9f-af0a-983844190335 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.058s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:09 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:49:09 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=25.19063949584961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 929e541e-d426-4ef2-9c0c-1f077384e38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:49:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:10 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:49:10 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:49:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:49:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing instance network info cache due to event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updated VIF entry in instance network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2b1da330-8768-450c-9d4f-64bc22b99013 req-15b91c85-461a-4e6e-aa6b-c07ce1677a53 service nova] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'flavor' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:12 user nova-compute[74820]: INFO nova.compute.manager [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Attaching volume 68cf405f-d418-461d-a22b-a4b343f3d12a to /dev/vdb
Nov 08 18:49:12 user nova-compute[74820]: DEBUG os_brick.utils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4931b9cf-cba4-4f4b-88a6-26eda66b7ced]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9712c-13f8-455b-9b91-4162f014696f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6de7758-d676-4739-8e40-3c8570952b87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ed7d2-95ff-49e6-920a-ab3bba5becd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:12 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:49:12 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b92c6-8d43-49b8-9af7-f49bbaf2accd]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG os_brick.utils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating existing volume attachment record: d7b61f6b-519b-4e53-b8b6-4db9b4a08c95 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:49:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:49:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:15 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:49:15 user nova-compute[74820]: INFO nova.compute.claims [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Claim successful on node user
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:49:16 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.policy [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d80baca13c04f37b8ea3d651536cdfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ad38240d754655a8f23b1dbc581507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:49:16 user nova-compute[74820]: INFO nova.virt.block_device [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Booting with volume 3f683e58-9068-43fb-82a3-550a535c49ff at /dev/vda
Nov 08 18:49:16 user nova-compute[74820]: DEBUG os_brick.utils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409bf9d-f0c1-4ac7-ba43-8e8807bcad30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[519b5d92-5f70-4c33-bc3f-e2096a12617b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa27bcbf-8290-4776-a738-da9f8e3b6523]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff0c32c-0104-4cd2-b294-dc73c575b6e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:16 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:49:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7db407-ad85-4abb-8f51-768485738d8e]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG os_brick.utils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:49:16 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating existing volume attachment record: 34d781f6-038c-4595-8085-b31e351a40b5 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:49:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Successfully created port: 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:49:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Successfully updated port: 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquired lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-changed-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Refreshing instance network info cache due to event network-changed-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] Acquiring lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating instance_info_cache with network_info: [{"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Releasing lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Instance network_info: |[{"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] Acquired lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:18 user nova-compute[74820]: DEBUG nova.network.neutron [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Refreshing network info cache for port 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:49:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updated VIF entry in instance network info cache for port 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:49:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating instance_info_cache with network_info: [{"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-594874b7-2f8b-49bf-9f21-9f3aacf34836 req-fa3c86be-40c7-4b2b-bc6c-6cef79638f55 service nova] Releasing lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEJqMOgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:49:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:49:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:49:26 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1164f42-2ae4-452e-a5a6-4826d883a1e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:49:26 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70097fd1-89dc-4e3d-9a21-b8b59dcf06ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458] added
Nov 08 18:49:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98752d39-a257-4742-a2d6-6a5de7e752dd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[998f1054-9311-4649-98e9-807da919d814]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IEJqMOgH {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IEJqMOgH" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf2ed8-8d76-40c0-8031-467f6c26e962]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IEJqMOgH'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[34315a05-487c-4763-9b2f-fb0aad58fe53]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f73bdc-3dd6-4f9b-a771-21f6fbed4ecb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 18:49:26 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 18:49:26 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:49:26 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 18:49:26 user nova-compute[74820]: 
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323ef8c-aaa5-46ab-b9df-8535db70b035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260]
Nov 08 18:49:26 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260] successful.
Nov 08 18:49:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ab0dc-2e74-4cee-baea-b2b4f62b6183]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d619f-1ec1-4253-9b4e-ad47d3a6febc]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:49:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:49:26 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d26df-e634-43ce-94d1-45f39ec29727]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:49:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEJqMOgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:49:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:49:27 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23666633736323962', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:49:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633736323962', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:49:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'flavor' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:49:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:49:27 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:49:27 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:49:27 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:49:27 user nova-compute[74820]:   <serial>11ac29c7-164d-4c9e-a1a6-8a554e2bf458</serial>
Nov 08 18:49:27 user nova-compute[74820]: </disk>
Nov 08 18:49:27 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:49:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:49:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:49:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No VIF found with MAC fa:16:3e:38:92:87, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:49:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-59baafb9-538a-4f4e-8583-a5a885b5b1d2 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.490s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:30 user nova-compute[74820]: INFO nova.compute.manager [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Terminating instance
Nov 08 18:49:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-7503e7fc-1951-4f72-a783-fc050489632d req-39cfd3bb-311e-4134-9ede-cf24516eb3aa service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-unplugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7503e7fc-1951-4f72-a783-fc050489632d req-39cfd3bb-311e-4134-9ede-cf24516eb3aa service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7503e7fc-1951-4f72-a783-fc050489632d req-39cfd3bb-311e-4134-9ede-cf24516eb3aa service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7503e7fc-1951-4f72-a783-fc050489632d req-39cfd3bb-311e-4134-9ede-cf24516eb3aa service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-7503e7fc-1951-4f72-a783-fc050489632d req-39cfd3bb-311e-4134-9ede-cf24516eb3aa service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-unplugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-7503e7fc-1951-4f72-a783-fc050489632d req-39cfd3bb-311e-4134-9ede-cf24516eb3aa service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-unplugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Instance destroyed successfully.
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lazy-loading 'resources' on Instance uuid afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-953348812',display_name='tempest-VolumesNegativeTest-instance-953348812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-953348812',id=40,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8744878c7583440e9f029d7d8228d235',ramdisk_id='',reservation_id='r-nru7081s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2025496426',owner_user_name='tempest-VolumesNegativeTest-2025496426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:47:48Z,user_data=None,user_id='01d3bbd5e6a44d5cb1d2c2b0991bc3ba',uuid=afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Converting VIF {"id": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "address": "fa:16:3e:71:c3:ea", "network": {"id": "7652f314-4f3a-4396-901e-b6f0820b6840", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0a3edb428ba644fba5458edbce56cdf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818f138e-1e", "ovs_interfaceid": "818f138e-1e69-48dd-bbb0-3e31c0c25061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG os_vif [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap818f138e-1e, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33d11847-8e2a-47ef-a025-aa444a84c0a1) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:49:31 user nova-compute[74820]: INFO os_vif [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c3:ea,bridge_name='br-int',has_traffic_filtering=True,id=818f138e-1e69-48dd-bbb0-3e31c0c25061,network=Network(7652f314-4f3a-4396-901e-b6f0820b6840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap818f138e-1e')
Nov 08 18:49:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Deleting instance files /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7_del
Nov 08 18:49:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Deletion of /opt/stack/data/nova/instances/afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7_del complete
Nov 08 18:49:31 user nova-compute[74820]: INFO nova.compute.manager [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 18:49:31 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:49:31 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'flavor' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:32 user nova-compute[74820]: INFO nova.compute.manager [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attaching volume 723d3286-864d-47e4-bdc6-a02116d687dc to /dev/vdc
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-a66c31d0-33d6-4604-9d69-0575007c9d42 req-d5fcccc7-92df-4aef-b531-850530919687 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-deleted-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:32 user nova-compute[74820]: INFO nova.compute.manager [req-a66c31d0-33d6-4604-9d69-0575007c9d42 req-d5fcccc7-92df-4aef-b531-850530919687 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Neutron deleted interface 818f138e-1e69-48dd-bbb0-3e31c0c25061; detaching it from the instance and deleting it from the info cache
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.network.neutron [req-a66c31d0-33d6-4604-9d69-0575007c9d42 req-d5fcccc7-92df-4aef-b531-850530919687 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:32 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Took 0.73 seconds to deallocate network for instance.
Nov 08 18:49:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-a66c31d0-33d6-4604-9d69-0575007c9d42 req-d5fcccc7-92df-4aef-b531-850530919687 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Detach interface failed, port_id=818f138e-1e69-48dd-bbb0-3e31c0c25061, reason: Instance afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7 could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c83046-8952-422a-80a0-b00768f4691d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b328fc4-e516-4d33-9bec-993f4e4e5cce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9fae14-a6b5-4317-ae78-566fca7fedb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1457ae58-3a6b-46dc-a135-3f081a3729b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:49:32 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[98942cd1-e27a-4291-b704-65c9d64d2a22]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating existing volume attachment record: 53f94022-5a7d-4e09-a0a8-70efbf9b7804 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:49:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.371s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:49:33 user nova-compute[74820]: INFO nova.compute.claims [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Claim successful on node user
Nov 08 18:49:33 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Deleted allocations for instance afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-af1319e6-f516-44bf-8a41-48e835d1723e tempest-VolumesNegativeTest-2025496426 tempest-VolumesNegativeTest-2025496426-project-member] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.380s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:33 user nova-compute[74820]: WARNING nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state deleted and task_state None.
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:33 user nova-compute[74820]: WARNING nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state deleted and task_state None.
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:33 user nova-compute[74820]: WARNING nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state deleted and task_state None.
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-unplugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-unplugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:33 user nova-compute[74820]: WARNING nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-unplugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state deleted and task_state None.
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Acquiring lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] Lock "afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] No waiting events found dispatching network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:49:33 user nova-compute[74820]: WARNING nova.compute.manager [req-05aa0f6f-1717-49d0-b52c-df15f2aa81f9 req-4bf1487e-4fe7-4953-8e60-d41f30c85cd7 service nova] [instance: afebcf5b-c5e7-4401-a21d-e95ab8a3f3e7] Received unexpected event network-vif-plugged-818f138e-1e69-48dd-bbb0-3e31c0c25061 for instance with vm_state deleted and task_state None.
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:49:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:33 user nova-compute[74820]: DEBUG nova.policy [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c758b51fdce147f2b8ab6f7994398b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b5a8f5964e4c988c7e54a51dc8be27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:49:33 user nova-compute[74820]: INFO nova.virt.block_device [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Booting with volume 71d88bb3-f4f6-466e-83a2-c65e8c17c66f at /dev/vda
Nov 08 18:49:34 user nova-compute[74820]: DEBUG nova.network.neutron [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Successfully created port: e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG nova.network.neutron [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Successfully updated port: e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG nova.network.neutron [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing instance network info cache due to event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:49:34 user nova-compute[74820]: DEBUG nova.network.neutron [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG nova.network.neutron [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance network_info: |[{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updated VIF entry in instance network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG nova.network.neutron [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:49:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a4880a97-ce55-4534-8f86-82099cb5bb37 req-1d117308-0cca-4129-a80c-2423d289d121 service nova] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:49:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:49:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:49:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:49:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:49:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:49:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:49:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:49:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:50:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:50:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating instance_info_cache with network_info: [{"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-929e541e-d426-4ef2-9c0c-1f077384e38c" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:07 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:50:10 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:50:10 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8400MB free_disk=25.186717987060547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 929e541e-d426-4ef2-9c0c-1f077384e38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8a9be69a-983b-43ec-a502-dae853095928 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:50:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:50:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:50:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:50:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:50:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkWgDLqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:50:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:30 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c22e4f-87b6-4bd2-a9df-6964a83abaca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:50:30 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6576806-554a-47f8-8f30-08368027fa29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a] added
Nov 08 18:50:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6ce24-c755-4344-a99a-77c3a8534e03]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf5206-5ed8-4f13-b32d-3194fcc289b4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkWgDLqY {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkWgDLqY" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd473a9-b4dc-44bd-a06c-7d9b2950740f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TkWgDLqY'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4da6f-fe1b-43f9-bb15-0a2bcc73c8a4]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ae63b-d99c-42a5-ac3a-4f5147a554fb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:50:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Creating image(s)
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Ensure instance console log exists: /opt/stack/data/nova/instances/dc9c5a40-7fb2-4982-81e4-17a634a05bce/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Start _get_guest_xml network_info=[{"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '34d781f6-038c-4595-8085-b31e351a40b5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc9c5a40-7fb2-4982-81e4-17a634a05bce', 'attached_at': '', 'detached_at': '', 'volume_id': '3f683e58-9068-43fb-82a3-550a535c49ff', 'serial': '3f683e58-9068-43fb-82a3-550a535c49ff'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:50:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:50:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[90789ddd-65ef-420f-8e02-cdb5d4e27ab3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260]
Nov 08 18:50:30 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260] successful.
Nov 08 18:50:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:50:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2ebf67-0e1e-4177-9251-34f9618c8b8a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYUBtZbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:50:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7cd5fe-7a91-463e-8838-07e9deeb32a2]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:30 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:30 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.utils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf4c13-3cf3-4406-b59e-060e341e9b21]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ca2aa7-49aa-4a4d-91d3-1a835ac54540]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkWgDLqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[284095da-a077-4999-a294-f10327c8bbfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bfc15b-1b6f-41fc-9287-6af018731e23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[03881976-f638-42e9-ab7e-7f639c784ff4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:50:31 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a742b01c-beda-4b1b-8d7a-d25d29cbf4fb]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.utils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating existing volume attachment record: ce871fa3-7bd5-4902-ae8f-74d60cd958d1 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23833336134643538', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833336134643538', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.076s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:31 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:31 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:50:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'flavor' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b47648c-64aa-4346-927e-a54d1277c01c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:50:32 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:50:32 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:50:32 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:50:32 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:50:32 user nova-compute[74820]:   <serial>68cf405f-d418-461d-a22b-a4b343f3d12a</serial>
Nov 08 18:50:32 user nova-compute[74820]: </disk>
Nov 08 18:50:32 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41660f39-65b9-4ad0-aed6-015771080530]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff] added
Nov 08 18:50:32 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea07e9-2672-4ba5-881e-9027f0ae7a49]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb037e-5d4c-495f-acf9-aec5a9b4aa94]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrJWgEvb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrJWgEvb" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b36e3-f3ee-4d4f-a442-da8eeb331d46]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrJWgEvb'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb4ee3e-4122-4df0-aeb6-339db902ba35]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afeb0e6-deea-49ce-b5b8-2aa7e8382e22]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:32 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:32 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:32 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:32 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[16edb476-3628-4696-974e-c5eed36f4ce8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]
Nov 08 18:50:32 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.
Nov 08 18:50:32 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad809814-67d6-418f-860a-9af48d0683e1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7ae8a-4cba-49f3-a3de-41fd103d7b8a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:32 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:32 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:32 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:32 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:32 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:32 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[524567d1-9c07-47b2-9e83-346cdeb98351]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:1c:9e:d2, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:50:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b5590809-7552-4008-b5d1-341ac5cba6d1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 80.019s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:33 user nova-compute[74820]: INFO nova.compute.manager [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Rescuing
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== connect_volume: return (2399ms) {'type': 'block', 'scsi_wwn': '23239333137643930', 'path': '/dev/sdd'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333137643930', 'path': '/dev/sdd'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.388s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:33 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:33 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee71a9-9c16-430f-9fdc-3bb4bbcbe94b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:50:33 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155071083',display_name='tempest-TestVolumeBootPattern-server-155071083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155071083',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-aurbptq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:49:16Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=dc9c5a40-7fb2-4982-81e4-17a634a05bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'pci_devices' on Instance uuid dc9c5a40-7fb2-4982-81e4-17a634a05bce {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:50:33 user nova-compute[74820]:   <uuid>dc9c5a40-7fb2-4982-81e4-17a634a05bce</uuid>
Nov 08 18:50:33 user nova-compute[74820]:   <name>instance-0000002a</name>
Nov 08 18:50:33 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:50:33 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:50:33 user nova-compute[74820]:   <metadata>
Nov 08 18:50:33 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:50:33 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:50:33 user nova-compute[74820]:       <nova:name>tempest-TestVolumeBootPattern-server-155071083</nova:name>
Nov 08 18:50:33 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:50:30</nova:creationTime>
Nov 08 18:50:33 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:50:33 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:50:33 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:50:33 user nova-compute[74820]:       <nova:owner>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:user uuid="4d80baca13c04f37b8ea3d651536cdfd">tempest-TestVolumeBootPattern-1148056077-project-member</nova:user>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:project uuid="f2ad38240d754655a8f23b1dbc581507">tempest-TestVolumeBootPattern-1148056077</nova:project>
Nov 08 18:50:33 user nova-compute[74820]:       </nova:owner>
Nov 08 18:50:33 user nova-compute[74820]:       <nova:ports>
Nov 08 18:50:33 user nova-compute[74820]:         <nova:port uuid="39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a">
Nov 08 18:50:33 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 18:50:33 user nova-compute[74820]:         </nova:port>
Nov 08 18:50:33 user nova-compute[74820]:       </nova:ports>
Nov 08 18:50:33 user nova-compute[74820]:     </nova:instance>
Nov 08 18:50:33 user nova-compute[74820]:   </metadata>
Nov 08 18:50:33 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:50:33 user nova-compute[74820]:     <system>
Nov 08 18:50:33 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:50:33 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:50:33 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:50:33 user nova-compute[74820]:       <entry name="serial">dc9c5a40-7fb2-4982-81e4-17a634a05bce</entry>
Nov 08 18:50:33 user nova-compute[74820]:       <entry name="uuid">dc9c5a40-7fb2-4982-81e4-17a634a05bce</entry>
Nov 08 18:50:33 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:50:33 user nova-compute[74820]:     </system>
Nov 08 18:50:33 user nova-compute[74820]:   </sysinfo>
Nov 08 18:50:33 user nova-compute[74820]:   <os>
Nov 08 18:50:33 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:50:33 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:50:33 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:50:33 user nova-compute[74820]:   </os>
Nov 08 18:50:33 user nova-compute[74820]:   <features>
Nov 08 18:50:33 user nova-compute[74820]:     <acpi/>
Nov 08 18:50:33 user nova-compute[74820]:     <apic/>
Nov 08 18:50:33 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:50:33 user nova-compute[74820]:   </features>
Nov 08 18:50:33 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:50:33 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:50:33 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:50:33 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:50:33 user nova-compute[74820]:   </clock>
Nov 08 18:50:33 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:50:33 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:50:33 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:50:33 user nova-compute[74820]:   </cpu>
Nov 08 18:50:33 user nova-compute[74820]:   <devices>
Nov 08 18:50:33 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:50:33 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:50:33 user nova-compute[74820]:       <source dev="/dev/sdd"/>
Nov 08 18:50:33 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:50:33 user nova-compute[74820]:       <serial>3f683e58-9068-43fb-82a3-550a535c49ff</serial>
Nov 08 18:50:33 user nova-compute[74820]:     </disk>
Nov 08 18:50:33 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:50:33 user nova-compute[74820]:       <mac address="fa:16:3e:c1:88:b8"/>
Nov 08 18:50:33 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:50:33 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:50:33 user nova-compute[74820]:       <target dev="tap39f6ee0a-6a"/>
Nov 08 18:50:33 user nova-compute[74820]:     </interface>
Nov 08 18:50:33 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:50:33 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/dc9c5a40-7fb2-4982-81e4-17a634a05bce/console.log" append="off"/>
Nov 08 18:50:33 user nova-compute[74820]:     </serial>
Nov 08 18:50:33 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:50:33 user nova-compute[74820]:     <video>
Nov 08 18:50:33 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:50:33 user nova-compute[74820]:     </video>
Nov 08 18:50:33 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:50:33 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:50:33 user nova-compute[74820]:     </rng>
Nov 08 18:50:33 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:50:33 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:50:33 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:50:33 user nova-compute[74820]:     </memballoon>
Nov 08 18:50:33 user nova-compute[74820]:   </devices>
Nov 08 18:50:33 user nova-compute[74820]: </domain>
Nov 08 18:50:33 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155071083',display_name='tempest-TestVolumeBootPattern-server-155071083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155071083',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-aurbptq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:49:16Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=dc9c5a40-7fb2-4982-81e4-17a634a05bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_vif [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a40a7ac-f166-401a-98b8-0ededfaeb796]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc] added
Nov 08 18:50:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '712cce89-eabb-5956-950f-f974e243b594', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39f6ee0a-6a, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39f6ee0a-6a, col_values=(('qos', UUID('2714b040-ff31-4614-8ad7-aa190a640d9e')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39f6ee0a-6a, col_values=(('external_ids', {'iface-id': '39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:88:b8', 'vm-uuid': 'dc9c5a40-7fb2-4982-81e4-17a634a05bce'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf36ef5d-ef1f-4095-b1f9-135d5ace1fff]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: INFO os_vif [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a')
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ea917-59c3-45b3-920b-1efe43c01cec]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYUBtZbX {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYUBtZbX" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd17436-d242-46d7-9712-7c55244c3ae5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYUBtZbX'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No VIF found with MAC fa:16:3e:c1:88:b8, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef34826-756a-4cf2-96bb-b474422a5c0b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44da9e30-6e4d-4f7a-ba71-0434598adfb2]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:33 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:33 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:33 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:33 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-605dcb2c-fb56-4077-a490-13600158556e req-96752374-9411-4f89-9b26-4f4f390220d8 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-605dcb2c-fb56-4077-a490-13600158556e req-96752374-9411-4f89-9b26-4f4f390220d8 service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-605dcb2c-fb56-4077-a490-13600158556e req-96752374-9411-4f89-9b26-4f4f390220d8 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-605dcb2c-fb56-4077-a490-13600158556e req-96752374-9411-4f89-9b26-4f4f390220d8 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG nova.compute.manager [req-605dcb2c-fb56-4077-a490-13600158556e req-96752374-9411-4f89-9b26-4f4f390220d8 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:50:34 user nova-compute[74820]: WARNING nova.compute.manager [req-605dcb2c-fb56-4077-a490-13600158556e req-96752374-9411-4f89-9b26-4f4f390220d8 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state active and task_state rescuing.
Nov 08 18:50:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --login" returned: 0 in 1.078s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139e566-bfb6-4084-8ed0-0fbb2462360b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260]
Nov 08 18:50:34 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260] successful.
Nov 08 18:50:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbdd11-8142-43d3-aa51-b8ffde9e89d1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aeaf3a-5d45-4c7d-83e3-d06c8291d1f0]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:34 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:34 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:34 user nova-compute[74820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc (non-flash)
Nov 08 18:50:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:34 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:34 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:34 user nova-compute[74820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc (non-flash)
Nov 08 18:50:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.325s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[04383184-3dca-43ee-9a5f-435f7e8ddf10]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:50:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYUBtZbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance destroyed successfully.
Nov 08 18:50:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Attempting rescue
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:50:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Creating image(s)
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'trusted_certs' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-ed057b47-55a9-4bbc-8c44-a02a4335e008 req-f104311e-56da-4e31-a267-cfcf39e9bea9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ed057b47-55a9-4bbc-8c44-a02a4335e008 req-f104311e-56da-4e31-a267-cfcf39e9bea9 service nova] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ed057b47-55a9-4bbc-8c44-a02a4335e008 req-f104311e-56da-4e31-a267-cfcf39e9bea9 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ed057b47-55a9-4bbc-8c44-a02a4335e008 req-f104311e-56da-4e31-a267-cfcf39e9bea9 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.compute.manager [req-ed057b47-55a9-4bbc-8c44-a02a4335e008 req-f104311e-56da-4e31-a267-cfcf39e9bea9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] No waiting events found dispatching network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:50:35 user nova-compute[74820]: WARNING nova.compute.manager [req-ed057b47-55a9-4bbc-8c44-a02a4335e008 req-f104311e-56da-4e31-a267-cfcf39e9bea9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received unexpected event network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a for instance with vm_state building and task_state spawning.
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.286s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue" returned: 0 in 0.058s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'migration_context' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<e3910a1a-aa2b-4dfc-ace7-6928fb2654e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Start _get_guest_xml network_info=[{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:1c:9e:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'resources' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<e3910a1a-aa2b-4dfc-ace7-6928fb2654e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'numa_topology' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<e3910a1a-aa2b-4dfc-ace7-6928fb2654e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:50:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:50:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<e3910a1a-aa2b-4dfc-ace7-6928fb2654e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1000166135',display_name='tempest-ServerRescueNegativeTestJSON-server-1000166135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1000166135',id=39,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObls43yFDmntriYPy6vbwWi0RmZvBHXny0HYOK3pRItq3z1rlG6Zz73KuEt48wSci6nbmbg5zxD1doyPrGdbPkuOOwLGB+TzMcQJ9g25ZjDmylTGJDQCiNejiVF8PSLxQ==',key_name='tempest-keypair-867934815',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-g2c7nad2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:47:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=e3910a1a-aa2b-4dfc-ace7-6928fb2654e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:1c:9e:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "vif_mac": "fa:16:3e:1c:9e:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'pci_devices' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Object Instance<e3910a1a-aa2b-4dfc-ace7-6928fb2654e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:50:35 user nova-compute[74820]:   <uuid>e3910a1a-aa2b-4dfc-ace7-6928fb2654e9</uuid>
Nov 08 18:50:35 user nova-compute[74820]:   <name>instance-00000027</name>
Nov 08 18:50:35 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:50:35 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:50:35 user nova-compute[74820]:   <metadata>
Nov 08 18:50:35 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:50:35 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:50:35 user nova-compute[74820]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1000166135</nova:name>
Nov 08 18:50:35 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:50:35</nova:creationTime>
Nov 08 18:50:35 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:50:35 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:50:35 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:50:35 user nova-compute[74820]:       <nova:owner>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:user uuid="cb2804c2bc374d52a2283e78f03959c6">tempest-ServerRescueNegativeTestJSON-1619361117-project-member</nova:user>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:project uuid="622d25fd48684d82bb673a57cf0a7928">tempest-ServerRescueNegativeTestJSON-1619361117</nova:project>
Nov 08 18:50:35 user nova-compute[74820]:       </nova:owner>
Nov 08 18:50:35 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:50:35 user nova-compute[74820]:       <nova:ports>
Nov 08 18:50:35 user nova-compute[74820]:         <nova:port uuid="373a77bf-0cb5-4375-a9c6-0f884f430b7a">
Nov 08 18:50:35 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 18:50:35 user nova-compute[74820]:         </nova:port>
Nov 08 18:50:35 user nova-compute[74820]:       </nova:ports>
Nov 08 18:50:35 user nova-compute[74820]:     </nova:instance>
Nov 08 18:50:35 user nova-compute[74820]:   </metadata>
Nov 08 18:50:35 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:50:35 user nova-compute[74820]:     <system>
Nov 08 18:50:35 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:50:35 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:50:35 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:50:35 user nova-compute[74820]:       <entry name="serial">e3910a1a-aa2b-4dfc-ace7-6928fb2654e9</entry>
Nov 08 18:50:35 user nova-compute[74820]:       <entry name="uuid">e3910a1a-aa2b-4dfc-ace7-6928fb2654e9</entry>
Nov 08 18:50:35 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:50:35 user nova-compute[74820]:     </system>
Nov 08 18:50:35 user nova-compute[74820]:   </sysinfo>
Nov 08 18:50:35 user nova-compute[74820]:   <os>
Nov 08 18:50:35 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:50:35 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:50:35 user nova-compute[74820]:   </os>
Nov 08 18:50:35 user nova-compute[74820]:   <features>
Nov 08 18:50:35 user nova-compute[74820]:     <acpi/>
Nov 08 18:50:35 user nova-compute[74820]:     <apic/>
Nov 08 18:50:35 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:50:35 user nova-compute[74820]:   </features>
Nov 08 18:50:35 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:50:35 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:50:35 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:50:35 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:50:35 user nova-compute[74820]:   </clock>
Nov 08 18:50:35 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:50:35 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:50:35 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:50:35 user nova-compute[74820]:   </cpu>
Nov 08 18:50:35 user nova-compute[74820]:   <devices>
Nov 08 18:50:35 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:50:35 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:50:35 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue"/>
Nov 08 18:50:35 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:50:35 user nova-compute[74820]:     </disk>
Nov 08 18:50:35 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:50:35 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:50:35 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk"/>
Nov 08 18:50:35 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:50:35 user nova-compute[74820]:     </disk>
Nov 08 18:50:35 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:50:35 user nova-compute[74820]:       <mac address="fa:16:3e:1c:9e:d2"/>
Nov 08 18:50:35 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:50:35 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:50:35 user nova-compute[74820]:       <target dev="tap373a77bf-0c"/>
Nov 08 18:50:35 user nova-compute[74820]:     </interface>
Nov 08 18:50:35 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:50:35 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/console.log" append="off"/>
Nov 08 18:50:35 user nova-compute[74820]:     </serial>
Nov 08 18:50:35 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:50:35 user nova-compute[74820]:     <video>
Nov 08 18:50:35 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:50:35 user nova-compute[74820]:     </video>
Nov 08 18:50:35 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:50:35 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:50:35 user nova-compute[74820]:     </rng>
Nov 08 18:50:35 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:50:35 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:50:35 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:50:35 user nova-compute[74820]:     </memballoon>
Nov 08 18:50:35 user nova-compute[74820]:   </devices>
Nov 08 18:50:35 user nova-compute[74820]: </domain>
Nov 08 18:50:35 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:50:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance destroyed successfully.
Nov 08 18:50:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.359s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] <== connect_volume: return (4747ms) {'type': 'block', 'scsi_wwn': '23438313132356534', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438313132356534', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'flavor' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] No VIF found with MAC fa:16:3e:1c:9e:d2, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:50:35 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:50:35 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:50:35 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 18:50:35 user nova-compute[74820]:   <serial>723d3286-864d-47e4-bdc6-a02116d687dc</serial>
Nov 08 18:50:35 user nova-compute[74820]: </disk>
Nov 08 18:50:35 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-971d5c8b-011b-4324-87f6-27d09c385c6a req-05d2f5f5-34d3-4add-a84b-2ebcebe77faf service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-971d5c8b-011b-4324-87f6-27d09c385c6a req-05d2f5f5-34d3-4add-a84b-2ebcebe77faf service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-971d5c8b-011b-4324-87f6-27d09c385c6a req-05d2f5f5-34d3-4add-a84b-2ebcebe77faf service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-971d5c8b-011b-4324-87f6-27d09c385c6a req-05d2f5f5-34d3-4add-a84b-2ebcebe77faf service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-971d5c8b-011b-4324-87f6-27d09c385c6a req-05d2f5f5-34d3-4add-a84b-2ebcebe77faf service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:50:36 user nova-compute[74820]: WARNING nova.compute.manager [req-971d5c8b-011b-4324-87f6-27d09c385c6a req-05d2f5f5-34d3-4add-a84b-2ebcebe77faf service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state active and task_state rescuing.
Nov 08 18:50:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] No VIF found with MAC fa:16:3e:38:92:87, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:50:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-e08d6f72-01b2-4ba8-b58b-a4ccd62250c9 tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.168s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:50:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Instance spawned successfully.
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-1c9499c7-31eb-4408-96e6-92412ca3640d req-29f121b0-a402-4494-8eed-285dce0c1755 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1c9499c7-31eb-4408-96e6-92412ca3640d req-29f121b0-a402-4494-8eed-285dce0c1755 service nova] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1c9499c7-31eb-4408-96e6-92412ca3640d req-29f121b0-a402-4494-8eed-285dce0c1755 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1c9499c7-31eb-4408-96e6-92412ca3640d req-29f121b0-a402-4494-8eed-285dce0c1755 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-1c9499c7-31eb-4408-96e6-92412ca3640d req-29f121b0-a402-4494-8eed-285dce0c1755 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] No waiting events found dispatching network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:50:37 user nova-compute[74820]: WARNING nova.compute.manager [req-1c9499c7-31eb-4408-96e6-92412ca3640d req-29f121b0-a402-4494-8eed-285dce0c1755 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received unexpected event network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a for instance with vm_state building and task_state spawning.
Nov 08 18:50:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:37 user nova-compute[74820]: INFO nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:37 user nova-compute[74820]: INFO nova.compute.manager [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Detaching volume 723d3286-864d-47e4-bdc6-a02116d687dc
Nov 08 18:50:37 user nova-compute[74820]: INFO nova.virt.block_device [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attempting to driver detach volume 723d3286-864d-47e4-bdc6-a02116d687dc from mountpoint /dev/vdc
Nov 08 18:50:37 user nova-compute[74820]: INFO nova.compute.manager [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Took 81.73 seconds to build instance.
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Attempting to detach device vdc from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:50:37 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:50:37 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:50:37 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 18:50:37 user nova-compute[74820]:   <serial>723d3286-864d-47e4-bdc6-a02116d687dc</serial>
Nov 08 18:50:37 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 18:50:37 user nova-compute[74820]: </disk>
Nov 08 18:50:37 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:50:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Successfully detached device vdc from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the persistent domain config.
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:50:37 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:50:37 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:50:37 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 18:50:37 user nova-compute[74820]:   <serial>723d3286-864d-47e4-bdc6-a02116d687dc</serial>
Nov 08 18:50:37 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 18:50:37 user nova-compute[74820]: </disk>
Nov 08 18:50:37 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-df66620f-52b2-431b-b551-8b05b8e12a08 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 81.840s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:50:38 user nova-compute[74820]: WARNING nova.compute.manager [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state active and task_state rescuing.
Nov 08 18:50:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG nova.compute.manager [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:50:38 user nova-compute[74820]: WARNING nova.compute.manager [req-be63078d-6c87-4067-a5e1-523530d95a95 req-6d5ee290-5b18-45b7-9ea6-15f5c4bc39ee service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state active and task_state rescuing.
Nov 08 18:50:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7b3c0bed-07ad-4623-b274-c4ffaf1d06cf tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:50:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing instance network info cache due to event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG nova.network.neutron [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG nova.network.neutron [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updated VIF entry in instance network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG nova.network.neutron [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:50:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-347bfafa-da08-4702-a3b1-2a3522a52347 req-549c9e5f-39a5-4359-9682-ad7ec75d68eb service nova] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:50:52 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:50:52 user nova-compute[74820]: INFO nova.compute.manager [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] instance snapshotting
Nov 08 18:50:52 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Beginning live snapshot process
Nov 08 18:50:52 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.210s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt2fo247w/fa9feb803f084e17a86ce029f5806c48.delta 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt2fo247w/fa9feb803f084e17a86ce029f5806c48.delta 1073741824" returned: 0 in 0.053s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:53 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 18:50:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:50:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 18:50:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 18:50:54 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:50:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt2fo247w/fa9feb803f084e17a86ce029f5806c48.delta /opt/stack/data/nova/instances/snapshots/tmpt2fo247w/fa9feb803f084e17a86ce029f5806c48 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:50:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt2fo247w/fa9feb803f084e17a86ce029f5806c48.delta /opt/stack/data/nova/instances/snapshots/tmpt2fo247w/fa9feb803f084e17a86ce029f5806c48" returned: 0 in 0.639s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Snapshot extracted, beginning image upload
Nov 08 18:50:58 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 929e541e-d426-4ef2-9c0c-1f077384e38c is timed out.
Nov 08 18:50:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Successfully detached device vdc from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the live domain config.
Nov 08 18:50:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYUBtZbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:50:58 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ea1d3-257b-4a4e-94f0-bd51acae92d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:50:58 user nova-compute[74820]: No targets found.
Nov 08 18:50:58 user nova-compute[74820]: iSNS:
Nov 08 18:50:58 user nova-compute[74820]: No targets found.
Nov 08 18:50:58 user nova-compute[74820]: STATIC:
Nov 08 18:50:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458
Nov 08 18:50:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:50:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:50:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc
Nov 08 18:50:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:50:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:50:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:50:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:50:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:50:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a
Nov 08 18:50:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:50:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:50:58 user nova-compute[74820]: FIRMWARE:
Nov 08 18:50:58 user nova-compute[74820]: No targets found.
Nov 08 18:50:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:50:58 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:50:58 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdefcf05-c8f7-4d81-be75-52d8f73cdf19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bbd7b7-8f36-48a4-a5a2-2877dd114c50]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:58 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:58 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:58 user nova-compute[74820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc (non-flash)
Nov 08 18:50:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:50:58 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:50:58 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:50:58 user nova-compute[74820]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc (non-flash)
Nov 08 18:50:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e287e8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56480b-41f5-4b8c-84dc-6775838560b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd88d8f-2b03-48e7-b147-22d979551aa6]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7f706-2c23-43e8-817b-96dabe1c164b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Snapshot image upload complete
Nov 08 18:50:58 user nova-compute[74820]: INFO nova.compute.manager [None req-a8942530-1fce-4693-8558-83432b792245 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Took 5.61 seconds to snapshot the instance on the hypervisor.
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14788c1-94a6-4d9f-9a4b-6d83f0a749a8]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019e6b3-2f1f-4427-b577-5588b30562f5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704569a-84f5-485a-a055-5fd7e57d89fd]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260]
Nov 08 18:50:58 user nova-compute[74820]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc, portal: 172.16.0.220,3260] successful.
Nov 08 18:50:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723d3286-864d-47e4-bdc6-a02116d687dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31eb375-f664-41bd-b770-f9177aa5dbc5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] <== disconnect_volume: return (338ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:50:59 user nova-compute[74820]: DEBUG nova.objects.instance [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'flavor' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:50:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-ee9ca549-3d1a-4564-98b4-c44a4e35d4ef tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:51:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:51:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:51:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:51:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:51:10 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:51:10 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:51:10 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8159MB free_disk=25.126110076904297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 929e541e-d426-4ef2-9c0c-1f077384e38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8a9be69a-983b-43ec-a502-dae853095928 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:51:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:51:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:51:24 user nova-compute[74820]: INFO nova.compute.claims [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Claim successful on node user
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:51:25 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.policy [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '606ff562346743d89a203e59084fefcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef84eead1b49079ef0ca885650e61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:51:25 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Creating image(s)
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.virt.images [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] b4d6cd59-84ac-476e-9b3e-669ed21595ca was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.part /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Successfully created port: 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.part /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.converted" returned: 0 in 0.160s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.970s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Successfully updated port: 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing instance network info cache due to event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9,backing_fmt=raw /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9,backing_fmt=raw /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk 1073741824" returned: 0 in 0.053s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:26 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance network_info: |[{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Cannot resize image /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Ensure instance console log exists: /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Start _get_guest_xml network_info=[{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:51:22Z,direct_url=<?>,disk_format='qcow2',id=b4d6cd59-84ac-476e-9b3e-669ed21595ca,min_disk=0,min_ram=0,name='tempest-scenario-img--351020039',owner='61ef84eead1b49079ef0ca885650e61e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:51:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'b4d6cd59-84ac-476e-9b3e-669ed21595ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:51:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:51:27 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:51:22Z,direct_url=<?>,disk_format='qcow2',id=b4d6cd59-84ac-476e-9b3e-669ed21595ca,min_disk=0,min_ram=0,name='tempest-scenario-img--351020039',owner='61ef84eead1b49079ef0ca885650e61e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:51:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1979140458',display_name='tempest-TestMinimumBasicScenario-server-1979140458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1979140458',id=44,image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMftBBI8Do7syVT0ExWaEfyhAaooQq0TQvwDDYzBqJirzEgdxmkWxu/xpkmMjc5KnpKv2/1O4sdaklmJfv0O4QCEQS6uKHKDyTjaDuGz9xM+grY0QKFmegoEO0pDz6qlvg==',key_name='tempest-TestMinimumBasicScenario-818040902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-bpi90qfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:51:25Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=a8dd70f3-5cb8-4500-aaad-e5b68c9c6775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'pci_devices' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:51:27 user nova-compute[74820]:   <uuid>a8dd70f3-5cb8-4500-aaad-e5b68c9c6775</uuid>
Nov 08 18:51:27 user nova-compute[74820]:   <name>instance-0000002c</name>
Nov 08 18:51:27 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:51:27 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:51:27 user nova-compute[74820]:   <metadata>
Nov 08 18:51:27 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:51:27 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:51:27 user nova-compute[74820]:       <nova:name>tempest-TestMinimumBasicScenario-server-1979140458</nova:name>
Nov 08 18:51:27 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:51:27</nova:creationTime>
Nov 08 18:51:27 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:51:27 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:51:27 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:51:27 user nova-compute[74820]:       <nova:owner>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:user uuid="606ff562346743d89a203e59084fefcf">tempest-TestMinimumBasicScenario-1799886163-project-member</nova:user>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:project uuid="61ef84eead1b49079ef0ca885650e61e">tempest-TestMinimumBasicScenario-1799886163</nova:project>
Nov 08 18:51:27 user nova-compute[74820]:       </nova:owner>
Nov 08 18:51:27 user nova-compute[74820]:       <nova:root type="image" uuid="b4d6cd59-84ac-476e-9b3e-669ed21595ca"/>
Nov 08 18:51:27 user nova-compute[74820]:       <nova:ports>
Nov 08 18:51:27 user nova-compute[74820]:         <nova:port uuid="71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd">
Nov 08 18:51:27 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 18:51:27 user nova-compute[74820]:         </nova:port>
Nov 08 18:51:27 user nova-compute[74820]:       </nova:ports>
Nov 08 18:51:27 user nova-compute[74820]:     </nova:instance>
Nov 08 18:51:27 user nova-compute[74820]:   </metadata>
Nov 08 18:51:27 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:51:27 user nova-compute[74820]:     <system>
Nov 08 18:51:27 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:51:27 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:51:27 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:51:27 user nova-compute[74820]:       <entry name="serial">a8dd70f3-5cb8-4500-aaad-e5b68c9c6775</entry>
Nov 08 18:51:27 user nova-compute[74820]:       <entry name="uuid">a8dd70f3-5cb8-4500-aaad-e5b68c9c6775</entry>
Nov 08 18:51:27 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:51:27 user nova-compute[74820]:     </system>
Nov 08 18:51:27 user nova-compute[74820]:   </sysinfo>
Nov 08 18:51:27 user nova-compute[74820]:   <os>
Nov 08 18:51:27 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:51:27 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:51:27 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:51:27 user nova-compute[74820]:   </os>
Nov 08 18:51:27 user nova-compute[74820]:   <features>
Nov 08 18:51:27 user nova-compute[74820]:     <acpi/>
Nov 08 18:51:27 user nova-compute[74820]:     <apic/>
Nov 08 18:51:27 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:51:27 user nova-compute[74820]:   </features>
Nov 08 18:51:27 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:51:27 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:51:27 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:51:27 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:51:27 user nova-compute[74820]:   </clock>
Nov 08 18:51:27 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:51:27 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:51:27 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:51:27 user nova-compute[74820]:   </cpu>
Nov 08 18:51:27 user nova-compute[74820]:   <devices>
Nov 08 18:51:27 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:51:27 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:51:27 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk"/>
Nov 08 18:51:27 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:51:27 user nova-compute[74820]:     </disk>
Nov 08 18:51:27 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:51:27 user nova-compute[74820]:       <mac address="fa:16:3e:a4:74:5b"/>
Nov 08 18:51:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:51:27 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:51:27 user nova-compute[74820]:       <target dev="tap71fbafbc-92"/>
Nov 08 18:51:27 user nova-compute[74820]:     </interface>
Nov 08 18:51:27 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:51:27 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/console.log" append="off"/>
Nov 08 18:51:27 user nova-compute[74820]:     </serial>
Nov 08 18:51:27 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:51:27 user nova-compute[74820]:     <video>
Nov 08 18:51:27 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:51:27 user nova-compute[74820]:     </video>
Nov 08 18:51:27 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:51:27 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:51:27 user nova-compute[74820]:     </rng>
Nov 08 18:51:27 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:51:27 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:51:27 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:51:27 user nova-compute[74820]:     </memballoon>
Nov 08 18:51:27 user nova-compute[74820]:   </devices>
Nov 08 18:51:27 user nova-compute[74820]: </domain>
Nov 08 18:51:27 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1979140458',display_name='tempest-TestMinimumBasicScenario-server-1979140458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1979140458',id=44,image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMftBBI8Do7syVT0ExWaEfyhAaooQq0TQvwDDYzBqJirzEgdxmkWxu/xpkmMjc5KnpKv2/1O4sdaklmJfv0O4QCEQS6uKHKDyTjaDuGz9xM+grY0QKFmegoEO0pDz6qlvg==',key_name='tempest-TestMinimumBasicScenario-818040902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-bpi90qfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:51:25Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=a8dd70f3-5cb8-4500-aaad-e5b68c9c6775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG os_vif [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '750bbc4f-b775-5547-80e5-64019d7d8999', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71fbafbc-92, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71fbafbc-92, col_values=(('qos', UUID('b03fce6f-f07f-49f3-9eb5-49b8d3dfc8d1')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71fbafbc-92, col_values=(('external_ids', {'iface-id': '71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:74:5b', 'vm-uuid': 'a8dd70f3-5cb8-4500-aaad-e5b68c9c6775'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:27 user nova-compute[74820]: INFO os_vif [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92')
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No VIF found with MAC fa:16:3e:a4:74:5b, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updated VIF entry in instance network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ff46f886-f4b6-4076-bf74-88b8550edeee req-04362af7-d7e9-40f6-98c2-36953b77667c service nova] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:27 user nova-compute[74820]: INFO nova.compute.manager [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Detaching volume 11ac29c7-164d-4c9e-a1a6-8a554e2bf458
Nov 08 18:51:28 user nova-compute[74820]: INFO nova.virt.block_device [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Attempting to driver detach volume 11ac29c7-164d-4c9e-a1a6-8a554e2bf458 from mountpoint /dev/vdb
Nov 08 18:51:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Attempting to detach device vdb from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:51:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:51:28 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:51:28 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:51:28 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:51:28 user nova-compute[74820]:   <serial>11ac29c7-164d-4c9e-a1a6-8a554e2bf458</serial>
Nov 08 18:51:28 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:51:28 user nova-compute[74820]: </disk>
Nov 08 18:51:28 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:51:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Successfully detached device vdb from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the persistent domain config.
Nov 08 18:51:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:51:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:51:28 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:51:28 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:51:28 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:51:28 user nova-compute[74820]:   <serial>11ac29c7-164d-4c9e-a1a6-8a554e2bf458</serial>
Nov 08 18:51:28 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:51:28 user nova-compute[74820]: </disk>
Nov 08 18:51:28 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:51:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-d36653c3-938b-4426-b2b5-ae924da45e31 req-79890544-f924-4948-83ea-f749350db6fb service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d36653c3-938b-4426-b2b5-ae924da45e31 req-79890544-f924-4948-83ea-f749350db6fb service nova] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d36653c3-938b-4426-b2b5-ae924da45e31 req-79890544-f924-4948-83ea-f749350db6fb service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d36653c3-938b-4426-b2b5-ae924da45e31 req-79890544-f924-4948-83ea-f749350db6fb service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-d36653c3-938b-4426-b2b5-ae924da45e31 req-79890544-f924-4948-83ea-f749350db6fb service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] No waiting events found dispatching network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:51:29 user nova-compute[74820]: WARNING nova.compute.manager [req-d36653c3-938b-4426-b2b5-ae924da45e31 req-79890544-f924-4948-83ea-f749350db6fb service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received unexpected event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd for instance with vm_state building and task_state spawning.
Nov 08 18:51:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:51:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance spawned successfully.
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:31 user nova-compute[74820]: INFO nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-680d8153-4cfa-4e93-9ef7-e2001ab7f7fe req-50540df6-cd00-4c51-a385-9dcae0f5cb72 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-680d8153-4cfa-4e93-9ef7-e2001ab7f7fe req-50540df6-cd00-4c51-a385-9dcae0f5cb72 service nova] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-680d8153-4cfa-4e93-9ef7-e2001ab7f7fe req-50540df6-cd00-4c51-a385-9dcae0f5cb72 service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-680d8153-4cfa-4e93-9ef7-e2001ab7f7fe req-50540df6-cd00-4c51-a385-9dcae0f5cb72 service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-680d8153-4cfa-4e93-9ef7-e2001ab7f7fe req-50540df6-cd00-4c51-a385-9dcae0f5cb72 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] No waiting events found dispatching network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:51:31 user nova-compute[74820]: WARNING nova.compute.manager [req-680d8153-4cfa-4e93-9ef7-e2001ab7f7fe req-50540df6-cd00-4c51-a385-9dcae0f5cb72 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received unexpected event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd for instance with vm_state building and task_state spawning.
Nov 08 18:51:31 user nova-compute[74820]: INFO nova.compute.manager [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Took 6.38 seconds to build instance.
Nov 08 18:51:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6cf174a6-d3cc-4812-ad9b-9bc6b3eb92ab tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.474s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:51:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Creating image(s)
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Ensure instance console log exists: /opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Start _get_guest_xml network_info=[{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'ce871fa3-7bd5-4902-ae8f-74d60cd958d1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a9be69a-983b-43ec-a502-dae853095928', 'attached_at': '', 'detached_at': '', 'volume_id': '71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'serial': '71d88bb3-f4f6-466e-83a2-c65e8c17c66f'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:51:39 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:51:39 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:51:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:51:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:51:39 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef55173-058a-4888-89bb-15020938dc8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:51:39 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d3f07-1b6c-4e2e-81f9-8c76edbda3f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f] added
Nov 08 18:51:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc382b-31b5-4e5d-b545-5f97c46271da]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d0b9c-7521-4524-a41a-6fe0e500558c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmFLPqEa {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmFLPqEa" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[463cab10-2499-453e-8e4b-0dcee229ba44]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmFLPqEa'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732e617-bc11-403e-8bdf-ca1f2c88b2bb]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3cfb96-59d0-4c9f-883a-3b31789aaeb1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:51:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:51:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c454f2-cafc-4940-a832-c743cc101c0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]
Nov 08 18:51:39 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.
Nov 08 18:51:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f09e343-e8d8-46fb-afda-4746346808ff]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[99999600-c130-49bc-809f-e2bf4cc43cb1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:51:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:51:39 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:51:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd537307-e9ce-42d7-b6d9-50b2b68c1778]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:51:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23537626439626263', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626439626263', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1353245481',display_name='tempest-TestShelveInstance-server-1353245481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1353245481',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQeOCrHm4DeWV0ReOpyBBKHDRGG2LNQ+7HAZLFkWagpY7jeDe2Tl2v/QsVMJggRUjBItFsgbrgxBRj8h+TA9k0J+3SB6CtANG6A5CgZa6++QROI81d7dVFAHZcNoLh6w==',key_name='tempest-TestShelveInstance-950946572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26b5a8f5964e4c988c7e54a51dc8be27',ramdisk_id='',reservation_id='r-q9p9zb3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1981518489',owner_user_name='tempest-TestShelveInstance-1981518489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:49:34Z,user_data=None,user_id='c758b51fdce147f2b8ab6f7994398b76',uuid=8a9be69a-983b-43ec-a502-dae853095928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converting VIF {"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:51:40 user nova-compute[74820]:   <uuid>8a9be69a-983b-43ec-a502-dae853095928</uuid>
Nov 08 18:51:40 user nova-compute[74820]:   <name>instance-0000002b</name>
Nov 08 18:51:40 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:51:40 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:51:40 user nova-compute[74820]:   <metadata>
Nov 08 18:51:40 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:51:40 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:51:40 user nova-compute[74820]:       <nova:name>tempest-TestShelveInstance-server-1353245481</nova:name>
Nov 08 18:51:40 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:51:39</nova:creationTime>
Nov 08 18:51:40 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:51:40 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:51:40 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:51:40 user nova-compute[74820]:       <nova:owner>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:user uuid="c758b51fdce147f2b8ab6f7994398b76">tempest-TestShelveInstance-1981518489-project-member</nova:user>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:project uuid="26b5a8f5964e4c988c7e54a51dc8be27">tempest-TestShelveInstance-1981518489</nova:project>
Nov 08 18:51:40 user nova-compute[74820]:       </nova:owner>
Nov 08 18:51:40 user nova-compute[74820]:       <nova:ports>
Nov 08 18:51:40 user nova-compute[74820]:         <nova:port uuid="e8360bd0-89e0-4f0e-9a18-01775def3efa">
Nov 08 18:51:40 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:51:40 user nova-compute[74820]:         </nova:port>
Nov 08 18:51:40 user nova-compute[74820]:       </nova:ports>
Nov 08 18:51:40 user nova-compute[74820]:     </nova:instance>
Nov 08 18:51:40 user nova-compute[74820]:   </metadata>
Nov 08 18:51:40 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:51:40 user nova-compute[74820]:     <system>
Nov 08 18:51:40 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:51:40 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:51:40 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:51:40 user nova-compute[74820]:       <entry name="serial">8a9be69a-983b-43ec-a502-dae853095928</entry>
Nov 08 18:51:40 user nova-compute[74820]:       <entry name="uuid">8a9be69a-983b-43ec-a502-dae853095928</entry>
Nov 08 18:51:40 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:51:40 user nova-compute[74820]:     </system>
Nov 08 18:51:40 user nova-compute[74820]:   </sysinfo>
Nov 08 18:51:40 user nova-compute[74820]:   <os>
Nov 08 18:51:40 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:51:40 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:51:40 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:51:40 user nova-compute[74820]:   </os>
Nov 08 18:51:40 user nova-compute[74820]:   <features>
Nov 08 18:51:40 user nova-compute[74820]:     <acpi/>
Nov 08 18:51:40 user nova-compute[74820]:     <apic/>
Nov 08 18:51:40 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:51:40 user nova-compute[74820]:   </features>
Nov 08 18:51:40 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:51:40 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:51:40 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:51:40 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:51:40 user nova-compute[74820]:   </clock>
Nov 08 18:51:40 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:51:40 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:51:40 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:51:40 user nova-compute[74820]:   </cpu>
Nov 08 18:51:40 user nova-compute[74820]:   <devices>
Nov 08 18:51:40 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:51:40 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:51:40 user nova-compute[74820]:       <source dev="/dev/sde"/>
Nov 08 18:51:40 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:51:40 user nova-compute[74820]:       <serial>71d88bb3-f4f6-466e-83a2-c65e8c17c66f</serial>
Nov 08 18:51:40 user nova-compute[74820]:     </disk>
Nov 08 18:51:40 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:51:40 user nova-compute[74820]:       <mac address="fa:16:3e:2d:f2:66"/>
Nov 08 18:51:40 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:51:40 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:51:40 user nova-compute[74820]:       <target dev="tape8360bd0-89"/>
Nov 08 18:51:40 user nova-compute[74820]:     </interface>
Nov 08 18:51:40 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:51:40 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928/console.log" append="off"/>
Nov 08 18:51:40 user nova-compute[74820]:     </serial>
Nov 08 18:51:40 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:51:40 user nova-compute[74820]:     <video>
Nov 08 18:51:40 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:51:40 user nova-compute[74820]:     </video>
Nov 08 18:51:40 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:51:40 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:51:40 user nova-compute[74820]:     </rng>
Nov 08 18:51:40 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:51:40 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:51:40 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:51:40 user nova-compute[74820]:     </memballoon>
Nov 08 18:51:40 user nova-compute[74820]:   </devices>
Nov 08 18:51:40 user nova-compute[74820]: </domain>
Nov 08 18:51:40 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1353245481',display_name='tempest-TestShelveInstance-server-1353245481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1353245481',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQeOCrHm4DeWV0ReOpyBBKHDRGG2LNQ+7HAZLFkWagpY7jeDe2Tl2v/QsVMJggRUjBItFsgbrgxBRj8h+TA9k0J+3SB6CtANG6A5CgZa6++QROI81d7dVFAHZcNoLh6w==',key_name='tempest-TestShelveInstance-950946572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26b5a8f5964e4c988c7e54a51dc8be27',ramdisk_id='',reservation_id='r-q9p9zb3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1981518489',owner_user_name='tempest-TestShelveInstance-1981518489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:49:34Z,user_data=None,user_id='c758b51fdce147f2b8ab6f7994398b76',uuid=8a9be69a-983b-43ec-a502-dae853095928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converting VIF {"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG os_vif [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c766880b-a747-5216-87ab-7525c151647f', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8360bd0-89, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8360bd0-89, col_values=(('qos', UUID('631d81d1-6f35-49b6-a95b-be8e1487731b')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8360bd0-89, col_values=(('external_ids', {'iface-id': 'e8360bd0-89e0-4f0e-9a18-01775def3efa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:66', 'vm-uuid': '8a9be69a-983b-43ec-a502-dae853095928'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:40 user nova-compute[74820]: INFO os_vif [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89')
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:51:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] No VIF found with MAC fa:16:3e:2d:f2:66, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-5a480d26-02eb-409d-9c4b-75bb0b940b60 req-65e24760-f088-4903-a90c-2f97daf2c560 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5a480d26-02eb-409d-9c4b-75bb0b940b60 req-65e24760-f088-4903-a90c-2f97daf2c560 service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5a480d26-02eb-409d-9c4b-75bb0b940b60 req-65e24760-f088-4903-a90c-2f97daf2c560 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5a480d26-02eb-409d-9c4b-75bb0b940b60 req-65e24760-f088-4903-a90c-2f97daf2c560 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-5a480d26-02eb-409d-9c4b-75bb0b940b60 req-65e24760-f088-4903-a90c-2f97daf2c560 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:51:42 user nova-compute[74820]: WARNING nova.compute.manager [req-5a480d26-02eb-409d-9c4b-75bb0b940b60 req-65e24760-f088-4903-a90c-2f97daf2c560 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state building and task_state spawning.
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:51:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance spawned successfully.
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:51:44 user nova-compute[74820]: INFO nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8dfc37a-c241-4130-8f0c-5a181a8134da req-1a143825-3097-4d1b-a022-5d96d19e7f00 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8dfc37a-c241-4130-8f0c-5a181a8134da req-1a143825-3097-4d1b-a022-5d96d19e7f00 service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8dfc37a-c241-4130-8f0c-5a181a8134da req-1a143825-3097-4d1b-a022-5d96d19e7f00 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a8dfc37a-c241-4130-8f0c-5a181a8134da req-1a143825-3097-4d1b-a022-5d96d19e7f00 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-a8dfc37a-c241-4130-8f0c-5a181a8134da req-1a143825-3097-4d1b-a022-5d96d19e7f00 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:51:44 user nova-compute[74820]: WARNING nova.compute.manager [req-a8dfc37a-c241-4130-8f0c-5a181a8134da req-1a143825-3097-4d1b-a022-5d96d19e7f00 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state building and task_state spawning.
Nov 08 18:51:44 user nova-compute[74820]: INFO nova.compute.manager [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Took 131.89 seconds to build instance.
Nov 08 18:51:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dd17ccf2-184a-48ea-a1f3-2b559fa14322 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 132.045s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:48 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 929e541e-d426-4ef2-9c0c-1f077384e38c is timed out.
Nov 08 18:51:48 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Successfully detached device vdb from instance 929e541e-d426-4ef2-9c0c-1f077384e38c from the live domain config.
Nov 08 18:51:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IEJqMOgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:51:48 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af90bc7-d547-4780-b00b-4a02a9191962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:51:48 user nova-compute[74820]: No targets found.
Nov 08 18:51:48 user nova-compute[74820]: iSNS:
Nov 08 18:51:48 user nova-compute[74820]: No targets found.
Nov 08 18:51:48 user nova-compute[74820]: STATIC:
Nov 08 18:51:48 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458
Nov 08 18:51:48 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:51:48 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:51:48 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f
Nov 08 18:51:48 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:51:48 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:51:48 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:51:48 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:51:48 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:51:48 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a
Nov 08 18:51:48 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:51:48 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:51:48 user nova-compute[74820]: FIRMWARE:
Nov 08 18:51:48 user nova-compute[74820]: No targets found.
Nov 08 18:51:48 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:51:48 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:51:48 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e101c-64b5-4cb0-b43e-2b794b8ac096]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10efd2c4-8e2f-4d2f-aa10-46da2d97b2c3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:51:48 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:51:48 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:51:48 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:51:48 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 (non-flash)
Nov 08 18:51:48 user nova-compute[74820]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:51:48 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:51:48 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:51:48 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2812caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[113160cd-3539-43a1-aa16-87a75fec50b7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b656345-354d-4543-97ae-9c5dbdce36b7]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[989dd194-6456-496a-ae90-b8ad11b05ff5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8ab52-c301-42a8-862b-73b585912d94]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5e6f7-f5aa-4c27-a55e-6b775d4a68d8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f580885e-953b-4e18-a76e-97bedf31fe96]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260]
Nov 08 18:51:49 user nova-compute[74820]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458, portal: 172.16.0.220,3260] successful.
Nov 08 18:51:49 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ac29c7-164d-4c9e-a1a6-8a554e2bf458 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0aaac6-b3dc-4209-9e5a-39d9a4ab0104]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] <== disconnect_volume: return (339ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:51:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:51:50 user nova-compute[74820]: DEBUG nova.objects.instance [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'flavor' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:51:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-68b7c41d-3d32-475f-b323-2710c5110e9d tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.093s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:51:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:52 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:51:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-changed-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG nova.compute.manager [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Refreshing instance network info cache due to event network-changed-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] Acquiring lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] Acquired lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Refreshing network info cache for port 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updated VIF entry in instance network info cache for port 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating instance_info_cache with network_info: [{"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:51:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-684ea7ff-fab3-4dc4-86c2-1d35577dc42a req-de3c2294-1dfd-45c6-b25f-47ca03044a01 service nova] Releasing lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:52:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:52:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:52:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:52:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:13 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:52:13 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=25.033145904541016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 929e541e-d426-4ef2-9c0c-1f077384e38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8a9be69a-983b-43ec-a502-dae853095928 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:52:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:52:17 user nova-compute[74820]: INFO nova.compute.claims [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Claim successful on node user
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:52:18 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:52:18 user nova-compute[74820]: INFO nova.virt.block_device [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Booting with volume 56008294-9a6d-4c96-b919-99d4a39dc1a7 at /dev/vda
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.policy [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d80baca13c04f37b8ea3d651536cdfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ad38240d754655a8f23b1dbc581507', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG os_brick.utils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5d47ec-635c-4811-af74-67458a0f6cab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d5fa4-1533-41db-ace2-07e986d8bde3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf7278-6ee6-4151-95db-29bfbebd1ad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90effdc-789f-4edc-8661-23b8e4a9d5b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:52:18 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab6b54-b85d-44e5-ac48-d8927513b9e5]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG os_brick.utils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updating existing volume attachment record: 4ae3f730-f72d-4fb1-9bfb-2a26b6fd1d15 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:18 user nova-compute[74820]: INFO nova.compute.manager [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Terminating instance
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-2a0cfe09-e5aa-479e-8f98-39146b4e9123 req-6b766d0f-7538-4425-8cfb-0e977124d6dc service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-vif-unplugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2a0cfe09-e5aa-479e-8f98-39146b4e9123 req-6b766d0f-7538-4425-8cfb-0e977124d6dc service nova] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2a0cfe09-e5aa-479e-8f98-39146b4e9123 req-6b766d0f-7538-4425-8cfb-0e977124d6dc service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2a0cfe09-e5aa-479e-8f98-39146b4e9123 req-6b766d0f-7538-4425-8cfb-0e977124d6dc service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-2a0cfe09-e5aa-479e-8f98-39146b4e9123 req-6b766d0f-7538-4425-8cfb-0e977124d6dc service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] No waiting events found dispatching network-vif-unplugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-2a0cfe09-e5aa-479e-8f98-39146b4e9123 req-6b766d0f-7538-4425-8cfb-0e977124d6dc service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-vif-unplugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Successfully created port: cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:52:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Instance destroyed successfully.
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lazy-loading 'resources' on Instance uuid 929e541e-d426-4ef2-9c0c-1f077384e38c {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1154119299',display_name='tempest-TestServerVolumeAttachmentScenario-server-1154119299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1154119299',id=38,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq+7XkImvtoQ8BcN4tT2x/PrzWq112tjMt0NcGpB+QJrj5kkPDW75QlE182wIoaSF+8XbCo/Iuyq5UE8meuLt+LinBWF58AJB4hKy81koteeivXRAhwnZpW9B6oUlchBw==',key_name='tempest-keypair-131043655',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3654d9e589554e51a0f7de7b13df6708',ramdisk_id='',reservation_id='r-wrjs8dko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-755067306',owner_user_name='tempest-TestServerVolumeAttachmentScenario-755067306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:47:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4206a1a856a413fb230bc83159a64e0',uuid=929e541e-d426-4ef2-9c0c-1f077384e38c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Converting VIF {"id": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "address": "fa:16:3e:38:92:87", "network": {"id": "83a9b7da-9d9f-4f18-b745-38352888c783", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1959507037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3654d9e589554e51a0f7de7b13df6708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd47e57b-92", "ovs_interfaceid": "fd47e57b-92ee-4a0b-ac68-b31b705229aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG os_vif [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd47e57b-92, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1be19ff0-3fce-484e-a2b7-5ab17d113591) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:19 user nova-compute[74820]: INFO os_vif [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:92:87,bridge_name='br-int',has_traffic_filtering=True,id=fd47e57b-92ee-4a0b-ac68-b31b705229aa,network=Network(83a9b7da-9d9f-4f18-b745-38352888c783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd47e57b-92')
Nov 08 18:52:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Deleting instance files /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c_del
Nov 08 18:52:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Deletion of /opt/stack/data/nova/instances/929e541e-d426-4ef2-9c0c-1f077384e38c_del complete
Nov 08 18:52:19 user nova-compute[74820]: INFO nova.compute.manager [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 18:52:19 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:52:19 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Successfully updated port: cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquired lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-changed-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Refreshing instance network info cache due to event network-changed-cc203a77-86b3-4286-b699-f482fb680083. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] Acquiring lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:52:20 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Took 0.85 seconds to deallocate network for instance.
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-9e81040b-28ae-41a7-bddd-c1ab0751d9ca req-b0af2d6f-9644-4094-87ad-6e3bd82666ce service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-vif-deleted-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:20 user nova-compute[74820]: INFO nova.compute.manager [req-9e81040b-28ae-41a7-bddd-c1ab0751d9ca req-b0af2d6f-9644-4094-87ad-6e3bd82666ce service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Neutron deleted interface fd47e57b-92ee-4a0b-ac68-b31b705229aa; detaching it from the instance and deleting it from the info cache
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-9e81040b-28ae-41a7-bddd-c1ab0751d9ca req-b0af2d6f-9644-4094-87ad-6e3bd82666ce service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.compute.manager [req-9e81040b-28ae-41a7-bddd-c1ab0751d9ca req-b0af2d6f-9644-4094-87ad-6e3bd82666ce service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Detach interface failed, port_id=fd47e57b-92ee-4a0b-ac68-b31b705229aa, reason: Instance 929e541e-d426-4ef2-9c0c-1f077384e38c could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updating instance_info_cache with network_info: [{"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Releasing lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Instance network_info: |[{"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] Acquired lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.network.neutron [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Refreshing network info cache for port cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:20 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Deleted allocations for instance 929e541e-d426-4ef2-9c0c-1f077384e38c
Nov 08 18:52:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e44a0c7-3e86-4439-ac73-8d8045edef4c tempest-TestServerVolumeAttachmentScenario-755067306 tempest-TestServerVolumeAttachmentScenario-755067306-project-member] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updated VIF entry in instance network info cache for port cc203a77-86b3-4286-b699-f482fb680083. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG nova.network.neutron [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updating instance_info_cache with network_info: [{"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4c533c44-6abe-4320-b745-fbd21a2c66b3 req-5a034002-4fd6-4706-9996-05a2ef78e8b6 service nova] Releasing lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-a81014cc-d36f-459f-92b7-adf1f5111fbc req-a459cc6e-1c97-4e13-b9c1-a74faf80318c service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received event network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a81014cc-d36f-459f-92b7-adf1f5111fbc req-a459cc6e-1c97-4e13-b9c1-a74faf80318c service nova] Acquiring lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a81014cc-d36f-459f-92b7-adf1f5111fbc req-a459cc6e-1c97-4e13-b9c1-a74faf80318c service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a81014cc-d36f-459f-92b7-adf1f5111fbc req-a459cc6e-1c97-4e13-b9c1-a74faf80318c service nova] Lock "929e541e-d426-4ef2-9c0c-1f077384e38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-a81014cc-d36f-459f-92b7-adf1f5111fbc req-a459cc6e-1c97-4e13-b9c1-a74faf80318c service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] No waiting events found dispatching network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:21 user nova-compute[74820]: WARNING nova.compute.manager [req-a81014cc-d36f-459f-92b7-adf1f5111fbc req-a459cc6e-1c97-4e13-b9c1-a74faf80318c service nova] [instance: 929e541e-d426-4ef2-9c0c-1f077384e38c] Received unexpected event network-vif-plugged-fd47e57b-92ee-4a0b-ac68-b31b705229aa for instance with vm_state deleted and task_state None.
Nov 08 18:52:24 user nova-compute[74820]: INFO nova.compute.manager [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Unrescuing
Nov 08 18:52:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:52:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:52:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:52:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:52:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:52:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'flavor' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-b5877306-7007-4120-8125-6f17ace71314 req-aee16530-b926-4830-ac59-7c979d66e5ad service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b5877306-7007-4120-8125-6f17ace71314 req-aee16530-b926-4830-ac59-7c979d66e5ad service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b5877306-7007-4120-8125-6f17ace71314 req-aee16530-b926-4830-ac59-7c979d66e5ad service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b5877306-7007-4120-8125-6f17ace71314 req-aee16530-b926-4830-ac59-7c979d66e5ad service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-b5877306-7007-4120-8125-6f17ace71314 req-aee16530-b926-4830-ac59-7c979d66e5ad service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:25 user nova-compute[74820]: WARNING nova.compute.manager [req-b5877306-7007-4120-8125-6f17ace71314 req-aee16530-b926-4830-ac59-7c979d66e5ad service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:52:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:25 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance destroyed successfully.
Nov 08 18:52:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:27 user nova-compute[74820]: WARNING nova.compute.manager [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:52:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:27 user nova-compute[74820]: DEBUG nova.compute.manager [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:27 user nova-compute[74820]: WARNING nova.compute.manager [req-e9441131-724f-4c0d-a437-252056df8c30 req-f34b0fd4-8631-4b24-a949-1d8c9f5ec322 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:52:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9d621765-c583-4a39-97a4-b8523380f0d7 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-7bdb05e7-5734-4341-a1ff-a7268c4b23a5 req-a794e2ce-2dcd-49ef-b0f2-b2353fe1657d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7bdb05e7-5734-4341-a1ff-a7268c4b23a5 req-a794e2ce-2dcd-49ef-b0f2-b2353fe1657d service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7bdb05e7-5734-4341-a1ff-a7268c4b23a5 req-a794e2ce-2dcd-49ef-b0f2-b2353fe1657d service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7bdb05e7-5734-4341-a1ff-a7268c4b23a5 req-a794e2ce-2dcd-49ef-b0f2-b2353fe1657d service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-7bdb05e7-5734-4341-a1ff-a7268c4b23a5 req-a794e2ce-2dcd-49ef-b0f2-b2353fe1657d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:29 user nova-compute[74820]: WARNING nova.compute.manager [req-7bdb05e7-5734-4341-a1ff-a7268c4b23a5 req-a794e2ce-2dcd-49ef-b0f2-b2353fe1657d service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state active and task_state None.
Nov 08 18:52:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:52:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:52:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:52:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:52:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:52:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:52:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Creating image(s)
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Ensure instance console log exists: /opt/stack/data/nova/instances/5db32542-c0fb-45b9-800c-f1e008498f1b/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Start _get_guest_xml network_info=[{"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '4ae3f730-f72d-4fb1-9bfb-2a26b6fd1d15', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyovmEea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5db32542-c0fb-45b9-800c-f1e008498f1b', 'attached_at': '', 'detached_at': '', 'volume_id': '56008294-9a6d-4c96-b919-99d4a39dc1a7', 'serial': '56008294-9a6d-4c96-b919-99d4a39dc1a7'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:52:42 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:52:42 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyovmEea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:52:42 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:52:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:52:42 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:52:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:52:42 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1f04d7-6e72-40ab-928c-0f46c28c8376]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:52:42 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc685c-3a48-4f17-ae06-21335adf9cc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7] added
Nov 08 18:52:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d26592-8b98-48fb-8699-26b064925744]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fdd26b-380d-492a-a6cd-093f5c4a4c6d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyovmEea {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyovmEea" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef54212-c8f5-4568-a8fd-10dc3501042c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OyovmEea'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e9cd5c-2cc2-4eb0-8956-638e3702ce99]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[091951b5-0e6f-4e45-b926-5f074c0393bd]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:52:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:52:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[df968fdf-df3b-455c-86c1-1f0cdc440b8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260]
Nov 08 18:52:43 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260] successful.
Nov 08 18:52:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1c218f-b2c0-439e-aa40-171d709e4469]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3719a8e-93b3-4c35-92ec-a814606fc05f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:52:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:52:43 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:52:43 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ba0c8-6fba-416e-a5be-fbe9e30f2f79]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyovmEea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG nova.objects.instance [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'flavor' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:52:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:44 user nova-compute[74820]: INFO nova.compute.manager [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Attaching volume 5eb41cce-44a4-400c-b0cf-b9c2e689153d to /dev/vdb
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.utils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a066f-0dc9-4a95-93db-6574cdd31849]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaac740-60f7-4cae-9eeb-b26a6e5b66fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4310283-5e5f-4b6e-8eaa-782ed7d361de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11fab63-b70f-46f4-a31a-6aa58b008889]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26565623038323634', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565623038323634', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:52:44 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:52:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ec19d0-9957-4425-86fd-8d8f6cfdc66b]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_brick.utils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating existing volume attachment record: 53f44171-4ca4-4b5b-a044-35e9a86bb4a5 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296852133',display_name='tempest-TestVolumeBootPattern-server-1296852133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296852133',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-72kzudg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:52:18Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=5db32542-c0fb-45b9-800c-f1e008498f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.objects.instance [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'pci_devices' on Instance uuid 5db32542-c0fb-45b9-800c-f1e008498f1b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:52:44 user nova-compute[74820]:   <uuid>5db32542-c0fb-45b9-800c-f1e008498f1b</uuid>
Nov 08 18:52:44 user nova-compute[74820]:   <name>instance-0000002d</name>
Nov 08 18:52:44 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:52:44 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:52:44 user nova-compute[74820]:   <metadata>
Nov 08 18:52:44 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:52:44 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:52:44 user nova-compute[74820]:       <nova:name>tempest-TestVolumeBootPattern-server-1296852133</nova:name>
Nov 08 18:52:44 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:52:42</nova:creationTime>
Nov 08 18:52:44 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:52:44 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:52:44 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:52:44 user nova-compute[74820]:       <nova:owner>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:user uuid="4d80baca13c04f37b8ea3d651536cdfd">tempest-TestVolumeBootPattern-1148056077-project-member</nova:user>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:project uuid="f2ad38240d754655a8f23b1dbc581507">tempest-TestVolumeBootPattern-1148056077</nova:project>
Nov 08 18:52:44 user nova-compute[74820]:       </nova:owner>
Nov 08 18:52:44 user nova-compute[74820]:       <nova:ports>
Nov 08 18:52:44 user nova-compute[74820]:         <nova:port uuid="cc203a77-86b3-4286-b699-f482fb680083">
Nov 08 18:52:44 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 18:52:44 user nova-compute[74820]:         </nova:port>
Nov 08 18:52:44 user nova-compute[74820]:       </nova:ports>
Nov 08 18:52:44 user nova-compute[74820]:     </nova:instance>
Nov 08 18:52:44 user nova-compute[74820]:   </metadata>
Nov 08 18:52:44 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:52:44 user nova-compute[74820]:     <system>
Nov 08 18:52:44 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:52:44 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:52:44 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:52:44 user nova-compute[74820]:       <entry name="serial">5db32542-c0fb-45b9-800c-f1e008498f1b</entry>
Nov 08 18:52:44 user nova-compute[74820]:       <entry name="uuid">5db32542-c0fb-45b9-800c-f1e008498f1b</entry>
Nov 08 18:52:44 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:52:44 user nova-compute[74820]:     </system>
Nov 08 18:52:44 user nova-compute[74820]:   </sysinfo>
Nov 08 18:52:44 user nova-compute[74820]:   <os>
Nov 08 18:52:44 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:52:44 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:52:44 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:52:44 user nova-compute[74820]:   </os>
Nov 08 18:52:44 user nova-compute[74820]:   <features>
Nov 08 18:52:44 user nova-compute[74820]:     <acpi/>
Nov 08 18:52:44 user nova-compute[74820]:     <apic/>
Nov 08 18:52:44 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:52:44 user nova-compute[74820]:   </features>
Nov 08 18:52:44 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:52:44 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:52:44 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:52:44 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:52:44 user nova-compute[74820]:   </clock>
Nov 08 18:52:44 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:52:44 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:52:44 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:52:44 user nova-compute[74820]:   </cpu>
Nov 08 18:52:44 user nova-compute[74820]:   <devices>
Nov 08 18:52:44 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:52:44 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:52:44 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 18:52:44 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:52:44 user nova-compute[74820]:       <serial>56008294-9a6d-4c96-b919-99d4a39dc1a7</serial>
Nov 08 18:52:44 user nova-compute[74820]:     </disk>
Nov 08 18:52:44 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:52:44 user nova-compute[74820]:       <mac address="fa:16:3e:fb:9e:d4"/>
Nov 08 18:52:44 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:52:44 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:52:44 user nova-compute[74820]:       <target dev="tapcc203a77-86"/>
Nov 08 18:52:44 user nova-compute[74820]:     </interface>
Nov 08 18:52:44 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:52:44 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/5db32542-c0fb-45b9-800c-f1e008498f1b/console.log" append="off"/>
Nov 08 18:52:44 user nova-compute[74820]:     </serial>
Nov 08 18:52:44 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:52:44 user nova-compute[74820]:     <video>
Nov 08 18:52:44 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:52:44 user nova-compute[74820]:     </video>
Nov 08 18:52:44 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:52:44 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:52:44 user nova-compute[74820]:     </rng>
Nov 08 18:52:44 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:52:44 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:52:44 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:52:44 user nova-compute[74820]:     </memballoon>
Nov 08 18:52:44 user nova-compute[74820]:   </devices>
Nov 08 18:52:44 user nova-compute[74820]: </domain>
Nov 08 18:52:44 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296852133',display_name='tempest-TestVolumeBootPattern-server-1296852133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296852133',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-72kzudg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:52:18Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=5db32542-c0fb-45b9-800c-f1e008498f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG os_vif [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb72cae6-39fc-5d2a-9276-3788eca74903', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc203a77-86, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc203a77-86, col_values=(('qos', UUID('e8045f41-c491-48bb-9629-2adb8b3b5b5e')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc203a77-86, col_values=(('external_ids', {'iface-id': 'cc203a77-86b3-4286-b699-f482fb680083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:9e:d4', 'vm-uuid': '5db32542-c0fb-45b9-800c-f1e008498f1b'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:44 user nova-compute[74820]: INFO os_vif [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86')
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:52:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] No VIF found with MAC fa:16:3e:fb:9e:d4, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-d3fe8fc7-2055-4260-baec-d829435beaa8 req-a2f46be3-6ca1-4c27-aba0-a9759f3c9c1d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d3fe8fc7-2055-4260-baec-d829435beaa8 req-a2f46be3-6ca1-4c27-aba0-a9759f3c9c1d service nova] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d3fe8fc7-2055-4260-baec-d829435beaa8 req-a2f46be3-6ca1-4c27-aba0-a9759f3c9c1d service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d3fe8fc7-2055-4260-baec-d829435beaa8 req-a2f46be3-6ca1-4c27-aba0-a9759f3c9c1d service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:45 user nova-compute[74820]: DEBUG nova.compute.manager [req-d3fe8fc7-2055-4260-baec-d829435beaa8 req-a2f46be3-6ca1-4c27-aba0-a9759f3c9c1d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] No waiting events found dispatching network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:45 user nova-compute[74820]: WARNING nova.compute.manager [req-d3fe8fc7-2055-4260-baec-d829435beaa8 req-a2f46be3-6ca1-4c27-aba0-a9759f3c9c1d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received unexpected event network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 for instance with vm_state building and task_state spawning.
Nov 08 18:52:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:52:47 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Instance spawned successfully.
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:52:47 user nova-compute[74820]: INFO nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-05e3ff25-4605-42a8-b03d-89f5d9fe1b1f req-686b2191-ec2a-4b73-a4c0-fd4f4d8c763d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05e3ff25-4605-42a8-b03d-89f5d9fe1b1f req-686b2191-ec2a-4b73-a4c0-fd4f4d8c763d service nova] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05e3ff25-4605-42a8-b03d-89f5d9fe1b1f req-686b2191-ec2a-4b73-a4c0-fd4f4d8c763d service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-05e3ff25-4605-42a8-b03d-89f5d9fe1b1f req-686b2191-ec2a-4b73-a4c0-fd4f4d8c763d service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-05e3ff25-4605-42a8-b03d-89f5d9fe1b1f req-686b2191-ec2a-4b73-a4c0-fd4f4d8c763d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] No waiting events found dispatching network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:52:47 user nova-compute[74820]: WARNING nova.compute.manager [req-05e3ff25-4605-42a8-b03d-89f5d9fe1b1f req-686b2191-ec2a-4b73-a4c0-fd4f4d8c763d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received unexpected event network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 for instance with vm_state building and task_state spawning.
Nov 08 18:52:48 user nova-compute[74820]: INFO nova.compute.manager [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Took 30.33 seconds to build instance.
Nov 08 18:52:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2146af3-3b98-46e6-b476-a392821411cd tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.440s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:52:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:52:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:52:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:53:04 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing instance network info cache due to event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG nova.network.neutron [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:05 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:06 user nova-compute[74820]: INFO nova.compute.manager [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Shelve offloading
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.network.neutron [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updated VIF entry in instance network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.network.neutron [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c1f2f596-e099-4700-938d-b1311735015a req-3de60a04-9b3f-4421-90e6-08b0e81874cc service nova] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-34a27467-a0f5-40f0-ab5c-8cd8cc84211e req-52f2916e-b7a4-4387-bdf7-361b3e33f49f service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-unplugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-34a27467-a0f5-40f0-ab5c-8cd8cc84211e req-52f2916e-b7a4-4387-bdf7-361b3e33f49f service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-34a27467-a0f5-40f0-ab5c-8cd8cc84211e req-52f2916e-b7a4-4387-bdf7-361b3e33f49f service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-34a27467-a0f5-40f0-ab5c-8cd8cc84211e req-52f2916e-b7a4-4387-bdf7-361b3e33f49f service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-34a27467-a0f5-40f0-ab5c-8cd8cc84211e req-52f2916e-b7a4-4387-bdf7-361b3e33f49f service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-unplugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:06 user nova-compute[74820]: WARNING nova.compute.manager [req-34a27467-a0f5-40f0-ab5c-8cd8cc84211e req-52f2916e-b7a4-4387-bdf7-361b3e33f49f service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-unplugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state active and task_state shelving.
Nov 08 18:53:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance destroyed successfully.
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:53:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [{"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-81728aff-572d-4015-b0a4-c299022d4ea1" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:53:07 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance destroyed successfully.
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.objects.instance [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'resources' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1353245481',display_name='tempest-TestShelveInstance-server-1353245481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1353245481',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQeOCrHm4DeWV0ReOpyBBKHDRGG2LNQ+7HAZLFkWagpY7jeDe2Tl2v/QsVMJggRUjBItFsgbrgxBRj8h+TA9k0J+3SB6CtANG6A5CgZa6++QROI81d7dVFAHZcNoLh6w==',key_name='tempest-TestShelveInstance-950946572',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26b5a8f5964e4c988c7e54a51dc8be27',ramdisk_id='',reservation_id='r-q9p9zb3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1981518489',owner_user_name='tempest-TestShelveInstance-1981518489-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:51:44Z,user_data=None,user_id='c758b51fdce147f2b8ab6f7994398b76',uuid=8a9be69a-983b-43ec-a502-dae853095928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converting VIF {"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG os_vif [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8360bd0-89, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing instance network info cache due to event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=631d81d1-6f35-49b6-a95b-be8e1487731b) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:07 user nova-compute[74820]: INFO os_vif [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89')
Nov 08 18:53:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:53:07 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:53:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:53:07 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a421f3f-af5f-49fe-82f6-5c85e453694e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:53:08 user nova-compute[74820]: No targets found.
Nov 08 18:53:08 user nova-compute[74820]: iSNS:
Nov 08 18:53:08 user nova-compute[74820]: No targets found.
Nov 08 18:53:08 user nova-compute[74820]: STATIC:
Nov 08 18:53:08 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f
Nov 08 18:53:08 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:53:08 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:53:08 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:53:08 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:53:08 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:53:08 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7
Nov 08 18:53:08 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:53:08 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:53:08 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a
Nov 08 18:53:08 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:53:08 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:53:08 user nova-compute[74820]: FIRMWARE:
Nov 08 18:53:08 user nova-compute[74820]: No targets found.
Nov 08 18:53:08 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:53:08 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:53:08 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de66de-329e-4937-8cec-4c7aef619e92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de66ab3-c5f2-41ef-a161-c2dd90a1de54]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:08 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:08 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:53:08 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:08 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:08 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:08 user nova-compute[74820]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:53:08 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:08 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e287e8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9015cb9-5fd9-41a9-b6c6-3414569600b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa481f6-9850-4659-8464-03848ceba5b7]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[53476cad-2e08-4903-8046-58909cff0fa5]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f855b2a3-b598-403d-b636-5267e104adc9]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a47d7d-2418-413d-b5d3-287b3c10e2b0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a786e5ea-4a8a-4d4b-b6e2-877877e46647]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]
Nov 08 18:53:08 user nova-compute[74820]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.
Nov 08 18:53:08 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[21895b75-aaa4-4128-9590-eb44ada59a7f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] <== disconnect_volume: return (344ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:53:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Deleting instance files /opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928_del
Nov 08 18:53:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Deletion of /opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928_del complete
Nov 08 18:53:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updated VIF entry in instance network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": null, "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape8360bd0-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f7d375ce-f47a-41e1-ab2d-86a68468a823 req-0a447f58-359d-4564-81b1-cd6e5367be7b service nova] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-e893604b-feb6-4ac9-a13d-6f58aa6cc283 req-ebeeaf68-61ca-41a9-bc13-fa0753df5da5 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e893604b-feb6-4ac9-a13d-6f58aa6cc283 req-ebeeaf68-61ca-41a9-bc13-fa0753df5da5 service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e893604b-feb6-4ac9-a13d-6f58aa6cc283 req-ebeeaf68-61ca-41a9-bc13-fa0753df5da5 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e893604b-feb6-4ac9-a13d-6f58aa6cc283 req-ebeeaf68-61ca-41a9-bc13-fa0753df5da5 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-e893604b-feb6-4ac9-a13d-6f58aa6cc283 req-ebeeaf68-61ca-41a9-bc13-fa0753df5da5 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:08 user nova-compute[74820]: WARNING nova.compute.manager [req-e893604b-feb6-4ac9-a13d-6f58aa6cc283 req-ebeeaf68-61ca-41a9-bc13-fa0753df5da5 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state active and task_state shelving.
Nov 08 18:53:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHebqBuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:53:09 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:53:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:53:09 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:53:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:53:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:53:09 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:53:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b093b65-d77f-41ce-a187-e4f4c0b357e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:53:10 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab299ec-6f92-4fc8-b55e-176287ef4699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d] added
Nov 08 18:53:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cfb6c9-6a4c-4d42-aaf3-6b786470c4df]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84fc835-dd99-4883-9afd-84c24a32aa7e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHebqBuk {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHebqBuk" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce11645-b46c-4e9e-989e-6efcbb72044c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHebqBuk'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c992a2c-0548-4985-a80a-c822ad11a9f2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[074cabe3-c508-4982-9d24-b356f6620a03]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a7ff8-acf2-4c49-bb67-005572b8a6d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260]
Nov 08 18:53:10 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260] successful.
Nov 08 18:53:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f33892-4aeb-4a14-8591-2fad06f0311a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f12e3-dbe6-4e65-834b-a8ab6f76a4e3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:53:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:10 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:53:10 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e3b583-2b72-475f-840c-e5e315af0725]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:10 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHebqBuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26630313738623661', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630313738623661', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.objects.instance [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'flavor' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:53:11 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:53:11 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:53:11 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:53:11 user nova-compute[74820]:   <serial>5eb41cce-44a4-400c-b0cf-b9c2e689153d</serial>
Nov 08 18:53:11 user nova-compute[74820]: </disk>
Nov 08 18:53:11 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No VIF found with MAC fa:16:3e:e2:24:d1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-50b06067-f073-4a93-9129-6737ba384718 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.913s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:53:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:53:12 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8002MB free_disk=25.041748046875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8a9be69a-983b-43ec-a502-dae853095928 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 5db32542-c0fb-45b9-800c-f1e008498f1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:53:12 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:53:13 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Deleted allocations for instance 8a9be69a-983b-43ec-a502-dae853095928
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.018s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.objects.instance [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.objects.base [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Object Instance<8a9be69a-983b-43ec-a502-dae853095928> lazy-loaded attributes: resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:53:13 user nova-compute[74820]: INFO nova.compute.manager [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Rescuing
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-599c2b06-44e1-4334-bde9-0e57de1ab97f tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.632s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca184a31-df69-4442-8e39-8ab673179792 req-d555fe75-ddb6-4c5d-8d0c-943625f1c3ae service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca184a31-df69-4442-8e39-8ab673179792 req-d555fe75-ddb6-4c5d-8d0c-943625f1c3ae service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca184a31-df69-4442-8e39-8ab673179792 req-d555fe75-ddb6-4c5d-8d0c-943625f1c3ae service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ca184a31-df69-4442-8e39-8ab673179792 req-d555fe75-ddb6-4c5d-8d0c-943625f1c3ae service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG nova.compute.manager [req-ca184a31-df69-4442-8e39-8ab673179792 req-d555fe75-ddb6-4c5d-8d0c-943625f1c3ae service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:14 user nova-compute[74820]: WARNING nova.compute.manager [req-ca184a31-df69-4442-8e39-8ab673179792 req-d555fe75-ddb6-4c5d-8d0c-943625f1c3ae service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state active and task_state rescuing.
Nov 08 18:53:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance destroyed successfully.
Nov 08 18:53:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Attempting a stable device rescue
Nov 08 18:53:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74820) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance directory exists: not creating {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 18:53:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Creating image(s)
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2cc55fdd6b0e375af445a8ceeece04995f7b8249" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2cc55fdd6b0e375af445a8ceeece04995f7b8249" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG nova.virt.images [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] b88186c4-22f1-4c31-a274-de171ee7a322 was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.part /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-99be3904-ec83-4e6c-8b14-3253ac6188fc req-a53c4a79-efc4-4c5d-860b-0daf40422969 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99be3904-ec83-4e6c-8b14-3253ac6188fc req-a53c4a79-efc4-4c5d-860b-0daf40422969 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99be3904-ec83-4e6c-8b14-3253ac6188fc req-a53c4a79-efc4-4c5d-860b-0daf40422969 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-99be3904-ec83-4e6c-8b14-3253ac6188fc req-a53c4a79-efc4-4c5d-860b-0daf40422969 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-99be3904-ec83-4e6c-8b14-3253ac6188fc req-a53c4a79-efc4-4c5d-860b-0daf40422969 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:16 user nova-compute[74820]: WARNING nova.compute.manager [req-99be3904-ec83-4e6c-8b14-3253ac6188fc req-a53c4a79-efc4-4c5d-860b-0daf40422969 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state active and task_state rescuing.
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.part /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.converted" returned: 0 in 0.550s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2cc55fdd6b0e375af445a8ceeece04995f7b8249" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.094s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2cc55fdd6b0e375af445a8ceeece04995f7b8249" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2cc55fdd6b0e375af445a8ceeece04995f7b8249" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249 --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249,backing_fmt=raw /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249,backing_fmt=raw /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue" returned: 0 in 0.058s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2cc55fdd6b0e375af445a8ceeece04995f7b8249" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'migration_context' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Object Instance<2543db51-ac21-4c92-8df1-d8c31b93ddbb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Start _get_guest_xml network_info=[{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "vif_mac": "fa:16:3e:e2:24:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b88186c4-22f1-4c31-a274-de171ee7a322', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '53f44171-4ca4-4b5b-a044-35e9a86bb4a5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHebqBuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2543db51-ac21-4c92-8df1-d8c31b93ddbb', 'attached_at': '', 'detached_at': '', 'volume_id': '5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'serial': '5eb41cce-44a4-400c-b0cf-b9c2e689153d'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'resources' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Object Instance<2543db51-ac21-4c92-8df1-d8c31b93ddbb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'numa_topology' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Object Instance<2543db51-ac21-4c92-8df1-d8c31b93ddbb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:53:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:53:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Object Instance<2543db51-ac21-4c92-8df1-d8c31b93ddbb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHebqBuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:53:17 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:53:17 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:53:17 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76d209-5999-4417-9ff6-24d169efb9f3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RHebqBuk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 18:53:17 user nova-compute[74820]: node.name = iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:53:17 user nova-compute[74820]: node.tpgt = -1
Nov 08 18:53:17 user nova-compute[74820]: node.startup = automatic
Nov 08 18:53:17 user nova-compute[74820]: node.leading_login = No
Nov 08 18:53:17 user nova-compute[74820]: iface.iscsi_ifacename = default
Nov 08 18:53:17 user nova-compute[74820]: iface.net_ifacename = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.ipaddress = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.prefix_len = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.hwaddress = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.transport_name = tcp
Nov 08 18:53:17 user nova-compute[74820]: iface.initiatorname = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.vlan_id = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.vlan_priority = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.vlan_state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.iface_num = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.mtu = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.port = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.bootproto = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.subnet_mask = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.gateway = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_alt_client_id = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_dns = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_learn_iqn = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_vendor_id_state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_vendor_id = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.dhcp_slp_da = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.fragmentation = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.gratuitous_arp = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.incoming_forwarding = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.tos_state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.tos = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.ttl = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.delayed_ack = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.tcp_nagle = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.tcp_wsf_state = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.tcp_wsf = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.tcp_timer_scale = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.tcp_timestamp = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.redirect = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.def_task_mgmt_timeout = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.header_digest = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.data_digest = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.immediate_data = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.initial_r2t = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.data_seq_inorder = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.data_pdu_inorder = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.erl = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.max_receive_data_len = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.first_burst_len = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.max_outstanding_r2t = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.max_burst_len = 0
Nov 08 18:53:17 user nova-compute[74820]: iface.chap_auth = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.bidi_chap = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.strict_login_compliance = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.discovery_auth = <empty>
Nov 08 18:53:17 user nova-compute[74820]: iface.discovery_logout = <empty>
Nov 08 18:53:17 user nova-compute[74820]: node.discovery_address = <empty>
Nov 08 18:53:17 user nova-compute[74820]: node.discovery_port = 0
Nov 08 18:53:17 user nova-compute[74820]: node.discovery_type = static
Nov 08 18:53:17 user nova-compute[74820]: node.session.initial_cmdsn = 0
Nov 08 18:53:17 user nova-compute[74820]: node.session.initial_login_retry_max = 8
Nov 08 18:53:17 user nova-compute[74820]: node.session.xmit_thread_priority = -20
Nov 08 18:53:17 user nova-compute[74820]: node.session.cmds_max = 128
Nov 08 18:53:17 user nova-compute[74820]: node.session.queue_depth = 32
Nov 08 18:53:17 user nova-compute[74820]: node.session.nr_sessions = 1
Nov 08 18:53:17 user nova-compute[74820]: node.session.auth.authmethod = CHAP
Nov 08 18:53:17 user nova-compute[74820]: node.session.auth.username = RHebqBuk
Nov 08 18:53:17 user nova-compute[74820]: node.session.auth.password = ***
Nov 08 18:53:17 user nova-compute[74820]: node.session.auth.username_in = <empty>
Nov 08 18:53:17 user nova-compute[74820]: node.session.auth.password_in = <empty>
Nov 08 18:53:17 user nova-compute[74820]: node.session.auth.chap_algs = MD5
Nov 08 18:53:17 user nova-compute[74820]: node.session.timeo.replacement_timeout = 120
Nov 08 18:53:17 user nova-compute[74820]: node.session.err_timeo.abort_timeout = 15
Nov 08 18:53:17 user nova-compute[74820]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 18:53:17 user nova-compute[74820]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 18:53:17 user nova-compute[74820]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.FastAbort = Yes
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.InitialR2T = No
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.ImmediateData = Yes
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.MaxConnections = 1
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 18:53:17 user nova-compute[74820]: node.session.iscsi.ERL = 0
Nov 08 18:53:17 user nova-compute[74820]: node.session.scan = manual
Nov 08 18:53:17 user nova-compute[74820]: node.session.reopen_max = 0
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].address = 172.16.0.220
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].port = 3260
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].startup = manual
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].tcp.window_size = 524288
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].tcp.type_of_service = 0
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].timeo.logout_timeout = 15
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].timeo.login_timeout = 15
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].timeo.auth_timeout = 45
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].iscsi.DataDigest = None
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].iscsi.IFMarker = No
Nov 08 18:53:17 user nova-compute[74820]: node.conn[0].iscsi.OFMarker = No
Nov 08 18:53:17 user nova-compute[74820]: # END RECORD
Nov 08 18:53:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbce3f6-c6ba-4fc6-b7b9-d644473ba52d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4660478a-53ea-4583-a8bd-b988aa4dbe5e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHebqBuk {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHebqBuk" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fbfd55-ac0f-4388-ac36-e8d49cbdaf3c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHebqBuk'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9870a7-c787-4e56-84ae-820de2164757]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b010e20-4180-4ffe-9ae8-78bc960428e9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:17 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:17 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:17 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:53:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:53:17 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:53:17 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:53:17 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:53:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] HCTL ('36', '0', '0', 0) found on session 36 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3472d68-abf4-455f-b0ee-188c47c4846d]: (4, ('0 0 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Searching for a device in session 36 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHebqBuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '26630313738623661', 'path': '/dev/sde'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630313738623661', 'path': '/dev/sde'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1420271536',display_name='tempest-ServerStableDeviceRescueTest-server-1420271536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1420271536',id=41,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM48eOi6v215srLN0TaqER5lRThokE6vti/AYowdlQxrwjHvAkaWKxfp+gH7Q25LzcqmiSFzRM2hIi6SdO7U0kWFfGvjRUPCqvLepecHDyaouFOMz+vfmyQ//+3+L1cvRA==',key_name='tempest-keypair-976236889',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:49:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d6dbf427cb540cda851042887350b47',ramdisk_id='',reservation_id='r-rf62ozlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1586196320',owner_user_name='tempest-ServerStableDeviceRescueTest-1586196320-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7487b21f1a7d456a879d0911ff2b8b7e',uuid=2543db51-ac21-4c92-8df1-d8c31b93ddbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "vif_mac": "fa:16:3e:e2:24:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converting VIF {"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "vif_mac": "fa:16:3e:e2:24:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'pci_devices' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.objects.base [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Object Instance<2543db51-ac21-4c92-8df1-d8c31b93ddbb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:53:17 user nova-compute[74820]:   <uuid>2543db51-ac21-4c92-8df1-d8c31b93ddbb</uuid>
Nov 08 18:53:17 user nova-compute[74820]:   <name>instance-00000029</name>
Nov 08 18:53:17 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:53:17 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:53:17 user nova-compute[74820]:   <metadata>
Nov 08 18:53:17 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:53:17 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:53:17 user nova-compute[74820]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1420271536</nova:name>
Nov 08 18:53:17 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:53:17</nova:creationTime>
Nov 08 18:53:17 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:53:17 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:53:17 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:53:17 user nova-compute[74820]:       <nova:owner>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:user uuid="7487b21f1a7d456a879d0911ff2b8b7e">tempest-ServerStableDeviceRescueTest-1586196320-project-member</nova:user>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:project uuid="3d6dbf427cb540cda851042887350b47">tempest-ServerStableDeviceRescueTest-1586196320</nova:project>
Nov 08 18:53:17 user nova-compute[74820]:       </nova:owner>
Nov 08 18:53:17 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:53:17 user nova-compute[74820]:       <nova:ports>
Nov 08 18:53:17 user nova-compute[74820]:         <nova:port uuid="3dd86d48-7b4f-4784-b80f-84e4f214f982">
Nov 08 18:53:17 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 18:53:17 user nova-compute[74820]:         </nova:port>
Nov 08 18:53:17 user nova-compute[74820]:       </nova:ports>
Nov 08 18:53:17 user nova-compute[74820]:     </nova:instance>
Nov 08 18:53:17 user nova-compute[74820]:   </metadata>
Nov 08 18:53:17 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:53:17 user nova-compute[74820]:     <system>
Nov 08 18:53:17 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:53:17 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:53:17 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:53:17 user nova-compute[74820]:       <entry name="serial">2543db51-ac21-4c92-8df1-d8c31b93ddbb</entry>
Nov 08 18:53:17 user nova-compute[74820]:       <entry name="uuid">2543db51-ac21-4c92-8df1-d8c31b93ddbb</entry>
Nov 08 18:53:17 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:53:17 user nova-compute[74820]:     </system>
Nov 08 18:53:17 user nova-compute[74820]:   </sysinfo>
Nov 08 18:53:17 user nova-compute[74820]:   <os>
Nov 08 18:53:17 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:53:17 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:53:17 user nova-compute[74820]:   </os>
Nov 08 18:53:17 user nova-compute[74820]:   <features>
Nov 08 18:53:17 user nova-compute[74820]:     <acpi/>
Nov 08 18:53:17 user nova-compute[74820]:     <apic/>
Nov 08 18:53:17 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:53:17 user nova-compute[74820]:   </features>
Nov 08 18:53:17 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:53:17 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:53:17 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:53:17 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:53:17 user nova-compute[74820]:   </clock>
Nov 08 18:53:17 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:53:17 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:53:17 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:53:17 user nova-compute[74820]:   </cpu>
Nov 08 18:53:17 user nova-compute[74820]:   <devices>
Nov 08 18:53:17 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:53:17 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:53:17 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk"/>
Nov 08 18:53:17 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:53:17 user nova-compute[74820]:     </disk>
Nov 08 18:53:17 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:53:17 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:53:17 user nova-compute[74820]:       <source dev="/dev/sde"/>
Nov 08 18:53:17 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:53:17 user nova-compute[74820]:       <serial>5eb41cce-44a4-400c-b0cf-b9c2e689153d</serial>
Nov 08 18:53:17 user nova-compute[74820]:     </disk>
Nov 08 18:53:17 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:53:17 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:53:17 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue"/>
Nov 08 18:53:17 user nova-compute[74820]:       <target dev="vdc" bus="virtio"/>
Nov 08 18:53:17 user nova-compute[74820]:       <boot order="1"/>
Nov 08 18:53:17 user nova-compute[74820]:     </disk>
Nov 08 18:53:17 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:53:17 user nova-compute[74820]:       <mac address="fa:16:3e:e2:24:d1"/>
Nov 08 18:53:17 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:53:17 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:53:17 user nova-compute[74820]:       <target dev="tap3dd86d48-7b"/>
Nov 08 18:53:17 user nova-compute[74820]:     </interface>
Nov 08 18:53:17 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:53:17 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/console.log" append="off"/>
Nov 08 18:53:17 user nova-compute[74820]:     </serial>
Nov 08 18:53:17 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:53:17 user nova-compute[74820]:     <video>
Nov 08 18:53:17 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:53:17 user nova-compute[74820]:     </video>
Nov 08 18:53:17 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:53:17 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:53:17 user nova-compute[74820]:     </rng>
Nov 08 18:53:17 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:53:17 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:53:17 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:53:17 user nova-compute[74820]:     </memballoon>
Nov 08 18:53:17 user nova-compute[74820]:   </devices>
Nov 08 18:53:17 user nova-compute[74820]: </domain>
Nov 08 18:53:17 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:53:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance destroyed successfully.
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] No VIF found with MAC fa:16:3e:e2:24:d1, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:53:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-d9a2c929-1dad-4840-9a87-c6c48d6d4932 req-c532bd22-26d9-4612-922b-d0861a8d081f service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d9a2c929-1dad-4840-9a87-c6c48d6d4932 req-c532bd22-26d9-4612-922b-d0861a8d081f service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d9a2c929-1dad-4840-9a87-c6c48d6d4932 req-c532bd22-26d9-4612-922b-d0861a8d081f service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d9a2c929-1dad-4840-9a87-c6c48d6d4932 req-c532bd22-26d9-4612-922b-d0861a8d081f service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG nova.compute.manager [req-d9a2c929-1dad-4840-9a87-c6c48d6d4932 req-c532bd22-26d9-4612-922b-d0861a8d081f service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:19 user nova-compute[74820]: WARNING nova.compute.manager [req-d9a2c929-1dad-4840-9a87-c6c48d6d4932 req-c532bd22-26d9-4612-922b-d0861a8d081f service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state active and task_state rescuing.
Nov 08 18:53:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-20a3c5e9-70d2-45bb-9eda-6de16e829bc2 req-dc3bcabb-c606-47f9-9fc0-2b148ec14215 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-20a3c5e9-70d2-45bb-9eda-6de16e829bc2 req-dc3bcabb-c606-47f9-9fc0-2b148ec14215 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-20a3c5e9-70d2-45bb-9eda-6de16e829bc2 req-dc3bcabb-c606-47f9-9fc0-2b148ec14215 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-20a3c5e9-70d2-45bb-9eda-6de16e829bc2 req-dc3bcabb-c606-47f9-9fc0-2b148ec14215 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-20a3c5e9-70d2-45bb-9eda-6de16e829bc2 req-dc3bcabb-c606-47f9-9fc0-2b148ec14215 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:21 user nova-compute[74820]: WARNING nova.compute.manager [req-20a3c5e9-70d2-45bb-9eda-6de16e829bc2 req-dc3bcabb-c606-47f9-9fc0-2b148ec14215 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state active and task_state rescuing.
Nov 08 18:53:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a2f38637-e1d9-4170-8072-a717bc6b2f48 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:53:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG nova.objects.instance [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'flavor' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:30 user nova-compute[74820]: INFO nova.compute.manager [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Attaching volume bc9a44b4-9841-461a-a61b-5aff3114689a to /dev/vdb
Nov 08 18:53:30 user nova-compute[74820]: DEBUG os_brick.utils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2677df6-c6f9-43d6-a20f-c7b8eb3fcebe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac8038-ec13-4dff-ad54-54fbf2aa4673]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9411193-44f9-4464-9258-0fc3063d1a6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[122ef023-89c7-463b-9747-f0f458ea91c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:53:30 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:53:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[afae50b2-7573-453a-8334-fd78b5cedc55]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG os_brick.utils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:53:30 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating existing volume attachment record: fc2b3f3a-4497-4a8f-b1a2-ef950c020df3 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:53:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid dc9c5a40-7fb2-4982-81e4-17a634a05bce {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 5db32542-c0fb-45b9-800c-f1e008498f1b {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:53:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:54 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:54 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:53:54 user nova-compute[74820]: INFO nova.compute.claims [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Claim successful on node user
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:53:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.policy [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dcc24a397d24301945b28fa99f71e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6925f3775d044967a0b31b1612874953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:53:55 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Creating image(s)
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "/opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "/opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "/opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.222s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.259s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:53:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk 1073741824" returned: 0 in 0.056s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Successfully created port: 57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.216s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Cannot resize image /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Ensure instance console log exists: /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:56 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Successfully updated port: 57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "refresh_cache-c006f656-bffe-4fd6-bb56-a4ec61defcc6" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquired lock "refresh_cache-c006f656-bffe-4fd6-bb56-a4ec61defcc6" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-changed-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.compute.manager [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Refreshing instance network info cache due to event network-changed-57cc03a4-2f5b-4427-a321-bd703cacc8a5. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] Acquiring lock "refresh_cache-c006f656-bffe-4fd6-bb56-a4ec61defcc6" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.neutron [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Updating instance_info_cache with network_info: [{"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Releasing lock "refresh_cache-c006f656-bffe-4fd6-bb56-a4ec61defcc6" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Instance network_info: |[{"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] Acquired lock "refresh_cache-c006f656-bffe-4fd6-bb56-a4ec61defcc6" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.neutron [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Refreshing network info cache for port 57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Start _get_guest_xml network_info=[{"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:53:57 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:53:57 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2062926124',display_name='tempest-VolumesActionsTest-instance-2062926124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2062926124',id=46,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6925f3775d044967a0b31b1612874953',ramdisk_id='',reservation_id='r-kg74f90j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1829984437',owner_user_name='tempest-VolumesActionsTest-1829984437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:53:55Z,user_data=None,user_id='3dcc24a397d24301945b28fa99f71e3d',uuid=c006f656-bffe-4fd6-bb56-a4ec61defcc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Converting VIF {"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.objects.instance [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lazy-loading 'pci_devices' on Instance uuid c006f656-bffe-4fd6-bb56-a4ec61defcc6 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:53:57 user nova-compute[74820]:   <uuid>c006f656-bffe-4fd6-bb56-a4ec61defcc6</uuid>
Nov 08 18:53:57 user nova-compute[74820]:   <name>instance-0000002e</name>
Nov 08 18:53:57 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:53:57 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:53:57 user nova-compute[74820]:   <metadata>
Nov 08 18:53:57 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:53:57 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:53:57 user nova-compute[74820]:       <nova:name>tempest-VolumesActionsTest-instance-2062926124</nova:name>
Nov 08 18:53:57 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:53:57</nova:creationTime>
Nov 08 18:53:57 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:53:57 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:53:57 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:53:57 user nova-compute[74820]:       <nova:owner>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:user uuid="3dcc24a397d24301945b28fa99f71e3d">tempest-VolumesActionsTest-1829984437-project-member</nova:user>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:project uuid="6925f3775d044967a0b31b1612874953">tempest-VolumesActionsTest-1829984437</nova:project>
Nov 08 18:53:57 user nova-compute[74820]:       </nova:owner>
Nov 08 18:53:57 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:53:57 user nova-compute[74820]:       <nova:ports>
Nov 08 18:53:57 user nova-compute[74820]:         <nova:port uuid="57cc03a4-2f5b-4427-a321-bd703cacc8a5">
Nov 08 18:53:57 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 18:53:57 user nova-compute[74820]:         </nova:port>
Nov 08 18:53:57 user nova-compute[74820]:       </nova:ports>
Nov 08 18:53:57 user nova-compute[74820]:     </nova:instance>
Nov 08 18:53:57 user nova-compute[74820]:   </metadata>
Nov 08 18:53:57 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:53:57 user nova-compute[74820]:     <system>
Nov 08 18:53:57 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:53:57 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:53:57 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:53:57 user nova-compute[74820]:       <entry name="serial">c006f656-bffe-4fd6-bb56-a4ec61defcc6</entry>
Nov 08 18:53:57 user nova-compute[74820]:       <entry name="uuid">c006f656-bffe-4fd6-bb56-a4ec61defcc6</entry>
Nov 08 18:53:57 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:53:57 user nova-compute[74820]:     </system>
Nov 08 18:53:57 user nova-compute[74820]:   </sysinfo>
Nov 08 18:53:57 user nova-compute[74820]:   <os>
Nov 08 18:53:57 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:53:57 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:53:57 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:53:57 user nova-compute[74820]:   </os>
Nov 08 18:53:57 user nova-compute[74820]:   <features>
Nov 08 18:53:57 user nova-compute[74820]:     <acpi/>
Nov 08 18:53:57 user nova-compute[74820]:     <apic/>
Nov 08 18:53:57 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:53:57 user nova-compute[74820]:   </features>
Nov 08 18:53:57 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:53:57 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:53:57 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:53:57 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:53:57 user nova-compute[74820]:   </clock>
Nov 08 18:53:57 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:53:57 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:53:57 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:53:57 user nova-compute[74820]:   </cpu>
Nov 08 18:53:57 user nova-compute[74820]:   <devices>
Nov 08 18:53:57 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:53:57 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:53:57 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk"/>
Nov 08 18:53:57 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:53:57 user nova-compute[74820]:     </disk>
Nov 08 18:53:57 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:53:57 user nova-compute[74820]:       <mac address="fa:16:3e:8e:7d:ed"/>
Nov 08 18:53:57 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:53:57 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:53:57 user nova-compute[74820]:       <target dev="tap57cc03a4-2f"/>
Nov 08 18:53:57 user nova-compute[74820]:     </interface>
Nov 08 18:53:57 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:53:57 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/console.log" append="off"/>
Nov 08 18:53:57 user nova-compute[74820]:     </serial>
Nov 08 18:53:57 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:53:57 user nova-compute[74820]:     <video>
Nov 08 18:53:57 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:53:57 user nova-compute[74820]:     </video>
Nov 08 18:53:57 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:53:57 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:53:57 user nova-compute[74820]:     </rng>
Nov 08 18:53:57 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:53:57 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:53:57 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:53:57 user nova-compute[74820]:     </memballoon>
Nov 08 18:53:57 user nova-compute[74820]:   </devices>
Nov 08 18:53:57 user nova-compute[74820]: </domain>
Nov 08 18:53:57 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2062926124',display_name='tempest-VolumesActionsTest-instance-2062926124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2062926124',id=46,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6925f3775d044967a0b31b1612874953',ramdisk_id='',reservation_id='r-kg74f90j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1829984437',owner_user_name='tempest-VolumesActionsTest-1829984437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:53:55Z,user_data=None,user_id='3dcc24a397d24301945b28fa99f71e3d',uuid=c006f656-bffe-4fd6-bb56-a4ec61defcc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Converting VIF {"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG os_vif [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9382555b-ddb6-587f-9779-4a6fcb78ec04', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57cc03a4-2f, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57cc03a4-2f, col_values=(('qos', UUID('27dfc7ac-d07a-469d-bce9-adfde434f91f')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57cc03a4-2f, col_values=(('external_ids', {'iface-id': '57cc03a4-2f5b-4427-a321-bd703cacc8a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:7d:ed', 'vm-uuid': 'c006f656-bffe-4fd6-bb56-a4ec61defcc6'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:57 user nova-compute[74820]: INFO os_vif [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f')
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:53:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] No VIF found with MAC fa:16:3e:8e:7d:ed, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Updated VIF entry in instance network info cache for port 57cc03a4-2f5b-4427-a321-bd703cacc8a5. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG nova.network.neutron [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Updating instance_info_cache with network_info: [{"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c84a3a6b-6722-40c0-a8bf-2cfdca3e5707 req-e66bf49c-14a6-4572-a9a7-8ac4a6867c4e service nova] Releasing lock "refresh_cache-c006f656-bffe-4fd6-bb56-a4ec61defcc6" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG nova.compute.manager [req-6ac0c074-bec8-4dc5-88c3-59a54ff8a5ed req-2961320a-ca70-4004-ae63-f9a2afdd3c6d service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6ac0c074-bec8-4dc5-88c3-59a54ff8a5ed req-2961320a-ca70-4004-ae63-f9a2afdd3c6d service nova] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6ac0c074-bec8-4dc5-88c3-59a54ff8a5ed req-2961320a-ca70-4004-ae63-f9a2afdd3c6d service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6ac0c074-bec8-4dc5-88c3-59a54ff8a5ed req-2961320a-ca70-4004-ae63-f9a2afdd3c6d service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG nova.compute.manager [req-6ac0c074-bec8-4dc5-88c3-59a54ff8a5ed req-2961320a-ca70-4004-ae63-f9a2afdd3c6d service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] No waiting events found dispatching network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:53:59 user nova-compute[74820]: WARNING nova.compute.manager [req-6ac0c074-bec8-4dc5-88c3-59a54ff8a5ed req-2961320a-ca70-4004-ae63-f9a2afdd3c6d service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received unexpected event network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 for instance with vm_state building and task_state spawning.
Nov 08 18:53:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:53:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:54:01 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Instance spawned successfully.
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-40e501e9-c5ff-47fe-bf86-f687c2092236 req-27cd46ff-c492-49a8-ba17-d0d6d04a6d74 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40e501e9-c5ff-47fe-bf86-f687c2092236 req-27cd46ff-c492-49a8-ba17-d0d6d04a6d74 service nova] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40e501e9-c5ff-47fe-bf86-f687c2092236 req-27cd46ff-c492-49a8-ba17-d0d6d04a6d74 service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40e501e9-c5ff-47fe-bf86-f687c2092236 req-27cd46ff-c492-49a8-ba17-d0d6d04a6d74 service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-40e501e9-c5ff-47fe-bf86-f687c2092236 req-27cd46ff-c492-49a8-ba17-d0d6d04a6d74 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] No waiting events found dispatching network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:01 user nova-compute[74820]: WARNING nova.compute.manager [req-40e501e9-c5ff-47fe-bf86-f687c2092236 req-27cd46ff-c492-49a8-ba17-d0d6d04a6d74 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received unexpected event network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 for instance with vm_state building and task_state spawning.
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:54:01 user nova-compute[74820]: INFO nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 08 18:54:01 user nova-compute[74820]: DEBUG nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:54:01 user nova-compute[74820]: INFO nova.compute.manager [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Took 6.74 seconds to build instance.
Nov 08 18:54:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-6f629f08-c622-4a41-a794-740615e51fed tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.843s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:54:05 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:05 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:05 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5ec460-b737-4009-9f01-86690c691585]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:54:05 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a52bf-4b61-4074-b1f2-ce14a3952efb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a] added
Nov 08 18:54:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f35048-6253-4b83-8b30-0411b77ef2c2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4bf040-254c-42c7-9c34-e1f17bad7ef1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyGkatQZ {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyGkatQZ" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fbccb8-d3a3-4dca-91b8-717eee0b6e50]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xyGkatQZ'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9167cdd-7f25-49c4-b953-e1aade57a82d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70401c70-2290-42d5-92ba-3ce11d965a47]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8c37b-3c85-47b6-ab50-90628d96fa54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]
Nov 08 18:54:05 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.
Nov 08 18:54:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b4e8d3-a8c2-44be-9ea8-23a61b186412]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b96ccb-6dbe-4294-bd8e-2a29cffa0305]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:05 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:05 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a4bcf3-dde3-49f5-b518-1235442fd7a5]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:54:05 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23432343864643835', 'path': '/dev/sdf'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432343864643835', 'path': '/dev/sdf'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG nova.objects.instance [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'flavor' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 18:54:06 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:54:06 user nova-compute[74820]:   <source dev="/dev/sdf"/>
Nov 08 18:54:06 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:54:06 user nova-compute[74820]:   <serial>bc9a44b4-9841-461a-a61b-5aff3114689a</serial>
Nov 08 18:54:06 user nova-compute[74820]: </disk>
Nov 08 18:54:06 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:06 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [{"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No VIF found with MAC fa:16:3e:a4:74:5b, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-195fa78f-a73f-494e-b95b-41b5061326b2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-dffac1d6-b4ae-48b5-a888-854dc1e51eb9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.870s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 33.294s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:54:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-changed-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Refreshing instance network info cache due to event network-changed-cc203a77-86b3-4286-b699-f482fb680083. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:54:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] Acquiring lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] Acquired lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Refreshing network info cache for port cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:54:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updated VIF entry in instance network info cache for port cc203a77-86b3-4286-b699-f482fb680083. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG nova.network.neutron [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updating instance_info_cache with network_info: [{"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-245ccff1-d062-4495-b34b-26ca8857316a req-0283eaf9-e621-491b-b320-a31a56ef01b9 service nova] Releasing lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:10 user nova-compute[74820]: INFO nova.compute.manager [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Terminating instance
Nov 08 18:54:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-31fb7780-1beb-4224-aee0-6167afe2bbdb req-7ffa993b-ccf8-49f8-8b17-f4fe8c7e39ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-vif-unplugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-31fb7780-1beb-4224-aee0-6167afe2bbdb req-7ffa993b-ccf8-49f8-8b17-f4fe8c7e39ba service nova] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-31fb7780-1beb-4224-aee0-6167afe2bbdb req-7ffa993b-ccf8-49f8-8b17-f4fe8c7e39ba service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-31fb7780-1beb-4224-aee0-6167afe2bbdb req-7ffa993b-ccf8-49f8-8b17-f4fe8c7e39ba service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-31fb7780-1beb-4224-aee0-6167afe2bbdb req-7ffa993b-ccf8-49f8-8b17-f4fe8c7e39ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] No waiting events found dispatching network-vif-unplugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-31fb7780-1beb-4224-aee0-6167afe2bbdb req-7ffa993b-ccf8-49f8-8b17-f4fe8c7e39ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-vif-unplugged-cc203a77-86b3-4286-b699-f482fb680083 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:54:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Instance destroyed successfully.
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.objects.instance [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'resources' on Instance uuid 5db32542-c0fb-45b9-800c-f1e008498f1b {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1296852133',display_name='tempest-TestVolumeBootPattern-server-1296852133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1296852133',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-72kzudg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:52:48Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=5db32542-c0fb-45b9-800c-f1e008498f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_vif [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc203a77-86, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8045f41-c491-48bb-9629-2adb8b3b5b5e) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:11 user nova-compute[74820]: INFO os_vif [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:9e:d4,bridge_name='br-int',has_traffic_filtering=True,id=cc203a77-86b3-4286-b699-f482fb680083,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc203a77-86')
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyovmEea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:54:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0441f5d5-e0d1-4f9d-9431-0c0d3f6ba598]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:54:11 user nova-compute[74820]: No targets found.
Nov 08 18:54:11 user nova-compute[74820]: iSNS:
Nov 08 18:54:11 user nova-compute[74820]: No targets found.
Nov 08 18:54:11 user nova-compute[74820]: STATIC:
Nov 08 18:54:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:54:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:54:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7
Nov 08 18:54:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a
Nov 08 18:54:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:11 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:54:11 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:11 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:11 user nova-compute[74820]: FIRMWARE:
Nov 08 18:54:11 user nova-compute[74820]: No targets found.
Nov 08 18:54:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:54:11 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:54:11 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efeb012-7510-49f7-a4d3-b522d206418e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc06d6-8934-4b7d-af4c-b1c4aeff22a1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:11 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28731510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b88e1f-e896-4041-b8c1-35d434f3fb22]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-changed-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Refreshing instance network info cache due to event network-changed-cc203a77-86b3-4286-b699-f482fb680083. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] Acquiring lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] Acquired lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.network.neutron [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Refreshing network info cache for port cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e412f4ae-16d4-46df-903e-9311aaf14cdf]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6aee16-8130-4fe4-a298-b20b37a3e650]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8978600a-0d8d-4a20-ba2e-fcfc1096d311]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce6c3d-ece3-4fd5-b4d5-6b5bdb6e400e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f695d86-55e5-4ea7-9e6d-746cdb0005cc]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260]
Nov 08 18:54:11 user nova-compute[74820]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7, portal: 172.16.0.220,3260] successful.
Nov 08 18:54:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56008294-9a6d-4c96-b919-99d4a39dc1a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03eee40-704a-4364-978f-29ec4ec9aefd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== disconnect_volume: return (383ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:54:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Deleting instance files /opt/stack/data/nova/instances/5db32542-c0fb-45b9-800c-f1e008498f1b_del
Nov 08 18:54:11 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Deletion of /opt/stack/data/nova/instances/5db32542-c0fb-45b9-800c-f1e008498f1b_del complete
Nov 08 18:54:11 user nova-compute[74820]: INFO nova.compute.manager [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 08 18:54:11 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:54:11 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updated VIF entry in instance network info cache for port cc203a77-86b3-4286-b699-f482fb680083. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG nova.network.neutron [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updating instance_info_cache with network_info: [{"id": "cc203a77-86b3-4286-b699-f482fb680083", "address": "fa:16:3e:fb:9e:d4", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc203a77-86", "ovs_interfaceid": "cc203a77-86b3-4286-b699-f482fb680083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3abbd9fc-6467-4770-aae0-b0017ba5aecb req-ca55c19c-8244-4587-aef4-6f2fbb6b32ba service nova] Releasing lock "refresh_cache-5db32542-c0fb-45b9-800c-f1e008498f1b" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:12 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Took 0.60 seconds to deallocate network for instance.
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:54:12 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] Acquiring lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] No waiting events found dispatching network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:13 user nova-compute[74820]: WARNING nova.compute.manager [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received unexpected event network-vif-plugged-cc203a77-86b3-4286-b699-f482fb680083 for instance with vm_state active and task_state deleting.
Nov 08 18:54:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-cc07b6eb-7685-4828-886d-6be85f36ad32 req-85140bba-514a-487f-820d-6e30d0d2fd0d service nova] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Received event network-vif-deleted-cc203a77-86b3-4286-b699-f482fb680083 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:54:13 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Error from libvirt while getting description of instance-0000002d: [Error Code 42] Domain not found: no domain with matching uuid '5db32542-c0fb-45b9-800c-f1e008498f1b' (instance-0000002d): libvirt.libvirtError: Domain not found: no domain with matching uuid '5db32542-c0fb-45b9-800c-f1e008498f1b' (instance-0000002d)
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:13 user nova-compute[74820]: INFO nova.compute.manager [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: 5db32542-c0fb-45b9-800c-f1e008498f1b] Took 1.21 seconds to detach 1 volumes for instance.
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:14 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Deleted allocations for instance 5db32542-c0fb-45b9-800c-f1e008498f1b
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-24afc3ce-96f1-437b-a074-05193e0a243a tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "5db32542-c0fb-45b9-800c-f1e008498f1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.765s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:54:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:54:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=7998MB free_disk=24.931926727294922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c006f656-bffe-4fd6-bb56-a4ec61defcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:54:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG nova.compute.manager [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing instance network info cache due to event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:16 user nova-compute[74820]: DEBUG nova.network.neutron [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:17 user nova-compute[74820]: INFO nova.compute.manager [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Detaching volume 68cf405f-d418-461d-a22b-a4b343f3d12a
Nov 08 18:54:17 user nova-compute[74820]: INFO nova.virt.block_device [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Attempting to driver detach volume 68cf405f-d418-461d-a22b-a4b343f3d12a from mountpoint /dev/vdb
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Attempting to detach device vdb from instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:54:17 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:54:17 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:54:17 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:54:17 user nova-compute[74820]:   <serial>68cf405f-d418-461d-a22b-a4b343f3d12a</serial>
Nov 08 18:54:17 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:54:17 user nova-compute[74820]: </disk>
Nov 08 18:54:17 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updated VIF entry in instance network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.network.neutron [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully detached device vdb from instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 from the persistent domain config.
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:54:17 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:54:17 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 18:54:17 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:54:17 user nova-compute[74820]:   <serial>68cf405f-d418-461d-a22b-a4b343f3d12a</serial>
Nov 08 18:54:17 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:54:17 user nova-compute[74820]: </disk>
Nov 08 18:54:17 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-afb10372-4d4d-4333-ab5e-cddaf2de5bdb req-9d5ed40d-524e-471f-8c7b-b5603ed1352c service nova] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:54:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing instance network info cache due to event network-changed-373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:54:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] Acquiring lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] Acquired lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:18 user nova-compute[74820]: DEBUG nova.network.neutron [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Refreshing network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:54:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updated VIF entry in instance network info cache for port 373a77bf-0cb5-4375-a9c6-0f884f430b7a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:54:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [{"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e63ea698-12e6-4f7e-8369-c8a0d7cbd437 req-98529351-771b-468c-9a38-6eeb128c4f5a service nova] Releasing lock "refresh_cache-e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing instance network info cache due to event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updated VIF entry in instance network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG nova.network.neutron [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c4363f11-d353-497d-9cac-0edd89fbc708 req-cab3f5c6-8e18-4770-92f4-efb9ef17d8aa service nova] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing instance network info cache due to event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updated VIF entry in instance network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:54:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fa15098e-7360-4846-835f-de4c16bac917 req-83aeddcb-7da4-40fc-b491-9a5c242ee1ae service nova] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 is timed out.
Nov 08 18:54:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully detached device vdb from instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 from the live domain config.
Nov 08 18:54:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkWgDLqY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:54:37 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[646342d4-4bbd-4c76-a746-86fd2377bf1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:54:37 user nova-compute[74820]: No targets found.
Nov 08 18:54:37 user nova-compute[74820]: iSNS:
Nov 08 18:54:37 user nova-compute[74820]: No targets found.
Nov 08 18:54:37 user nova-compute[74820]: STATIC:
Nov 08 18:54:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:54:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:54:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a
Nov 08 18:54:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:37 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:54:37 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:37 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:37 user nova-compute[74820]: FIRMWARE:
Nov 08 18:54:37 user nova-compute[74820]: No targets found.
Nov 08 18:54:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:54:37 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:54:37 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1282d04f-c2dc-4610-82dd-9dd42b4e441f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a76eb8-419a-4e99-b784-cbf018212c4a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:37 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:37 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:37 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a (non-flash)
Nov 08 18:54:37 user nova-compute[74820]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:37 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:37 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e40382c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d4e4bc-0663-4791-b01d-2ed00a9831ae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9c5f1-3530-49f3-ae28-11481d50c9cf]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c1663-4646-466c-8d75-ebfbf540fc3f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d45e4-a9e1-42af-ba92-ebc129c2bf97]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3829c083-9924-4963-acaa-71d7b48c4964]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7102e13-6131-435b-bb08-c8a57d2cfe3c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260]
Nov 08 18:54:37 user nova-compute[74820]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a, portal: 172.16.0.220,3260] successful.
Nov 08 18:54:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68cf405f-d418-461d-a22b-a4b343f3d12a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf7f0fc-db54-4172-bd65-177ce9d214d8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] <== disconnect_volume: return (312ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:54:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:54:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'flavor' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-3404cb41-8b31-4bc9-9fe5-df6901bc9a1b tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.825s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:45 user nova-compute[74820]: INFO nova.compute.manager [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Rebooting instance
Nov 08 18:54:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:54:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-9ae20767-41f6-4dbc-921d-a795b748ddc8 req-e06b2350-fa7e-466f-8328-83be1d17aa30 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-unplugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9ae20767-41f6-4dbc-921d-a795b748ddc8 req-e06b2350-fa7e-466f-8328-83be1d17aa30 service nova] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9ae20767-41f6-4dbc-921d-a795b748ddc8 req-e06b2350-fa7e-466f-8328-83be1d17aa30 service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9ae20767-41f6-4dbc-921d-a795b748ddc8 req-e06b2350-fa7e-466f-8328-83be1d17aa30 service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-9ae20767-41f6-4dbc-921d-a795b748ddc8 req-e06b2350-fa7e-466f-8328-83be1d17aa30 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] No waiting events found dispatching network-vif-unplugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:46 user nova-compute[74820]: WARNING nova.compute.manager [req-9ae20767-41f6-4dbc-921d-a795b748ddc8 req-e06b2350-fa7e-466f-8328-83be1d17aa30 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received unexpected event network-vif-unplugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd for instance with vm_state active and task_state reboot_started_hard.
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance destroyed successfully.
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'resources' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1979140458',display_name='tempest-TestMinimumBasicScenario-server-1979140458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1979140458',id=44,image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMftBBI8Do7syVT0ExWaEfyhAaooQq0TQvwDDYzBqJirzEgdxmkWxu/xpkmMjc5KnpKv2/1O4sdaklmJfv0O4QCEQS6uKHKDyTjaDuGz9xM+grY0QKFmegoEO0pDz6qlvg==',key_name='tempest-TestMinimumBasicScenario-818040902',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-bpi90qfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:54:46Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=a8dd70f3-5cb8-4500-aaad-e5b68c9c6775,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71fbafbc-92, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b03fce6f-f07f-49f3-9eb5-49b8d3dfc8d1) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:54:46 user nova-compute[74820]: INFO os_vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92')
Nov 08 18:54:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:54:46 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c79783a-9e18-4e58-9dd1-47f92dbd80d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:54:46 user nova-compute[74820]: No targets found.
Nov 08 18:54:46 user nova-compute[74820]: iSNS:
Nov 08 18:54:46 user nova-compute[74820]: No targets found.
Nov 08 18:54:46 user nova-compute[74820]: STATIC:
Nov 08 18:54:46 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:54:46 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:46 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:46 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:54:46 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:46 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:46 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:54:46 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:54:46 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:54:46 user nova-compute[74820]: FIRMWARE:
Nov 08 18:54:46 user nova-compute[74820]: No targets found.
Nov 08 18:54:46 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:54:46 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:54:46 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cd6f52-a68c-4fa8-b1a3-d4d4b9cf99f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e18480f-b6b2-4e67-8846-f21dd2910944]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:46 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:46 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:46 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:46 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:46 user nova-compute[74820]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:46 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e482ae3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a'): ({'sdf'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Removing single pathed devices sdf {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac22e8-5baa-4fe7-b6be-6663901d2707]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab6660-e29d-4e34-8045-389b1a837b63]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flushing IO for device /dev/sdf {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c626164-ab97-404d-9b0b-2604d730218b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:54:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4fe926-ebb6-44f8-8f70-c77d5cb44b5e]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] SCSI volumes sdf have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64782410-352d-467d-a53a-77705fe7c376]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3620c0c4-4c4d-4ea5-8176-ea5ca1142e16]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]
Nov 08 18:54:47 user nova-compute[74820]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d40ffa-8c9b-402c-ad20-8d43cf970ee0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== disconnect_volume: return (321ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Start _get_guest_xml network_info=[{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4d6cd59-84ac-476e-9b3e-669ed21595ca,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'b4d6cd59-84ac-476e-9b3e-669ed21595ca'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'fc2b3f3a-4497-4a8f-b1a2-ef950c020df3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a8dd70f3-5cb8-4500-aaad-e5b68c9c6775', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc9a44b4-9841-461a-a61b-5aff3114689a', 'serial': 'bc9a44b4-9841-461a-a61b-5aff3114689a'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:54:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:54:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4d6cd59-84ac-476e-9b3e-669ed21595ca,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.objects.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Object Instance<a8dd70f3-5cb8-4500-aaad-e5b68c9c6775> lazy-loaded attributes: resources,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:54:47 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:47 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:54:47 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[659bf625-f66b-466c-9fb4-40aeddbdaa6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:54:47 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ef2ee-ed63-4587-b0ba-c7a80dee6149]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a] added
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[810c751f-20bc-42d2-9731-c4bc6df93da9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd10c5-6a3c-425f-95c5-71804c6eca96]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyGkatQZ {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyGkatQZ" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9c8bb3-0d18-47bd-a31d-05aa5d22cb37]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xyGkatQZ'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e0551-edbd-42b8-9ffe-7c0c4d1b7953]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae6356-279c-4aaa-802f-5f0f9791478e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:47 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:47 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f45e8-337e-4a01-a456-08795a0d8276]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]
Nov 08 18:54:47 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ecddd2-4300-4653-887e-743451715562]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3d8d65-75dd-49e1-9b46-761eba14537c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:47 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:47 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:54:47 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:54:47 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:54:47 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c278cc4-b8cc-4d5a-a2c2-23ab3c561522]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:47 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-909a1c83-ca67-4a03-87b9-bd18f9885e2d req-1e173f9a-e6ac-47d2-97e1-8b092d9c2b34 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-909a1c83-ca67-4a03-87b9-bd18f9885e2d req-1e173f9a-e6ac-47d2-97e1-8b092d9c2b34 service nova] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-909a1c83-ca67-4a03-87b9-bd18f9885e2d req-1e173f9a-e6ac-47d2-97e1-8b092d9c2b34 service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-909a1c83-ca67-4a03-87b9-bd18f9885e2d req-1e173f9a-e6ac-47d2-97e1-8b092d9c2b34 service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-909a1c83-ca67-4a03-87b9-bd18f9885e2d req-1e173f9a-e6ac-47d2-97e1-8b092d9c2b34 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] No waiting events found dispatching network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:48 user nova-compute[74820]: WARNING nova.compute.manager [req-909a1c83-ca67-4a03-87b9-bd18f9885e2d req-1e173f9a-e6ac-47d2-97e1-8b092d9c2b34 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received unexpected event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd for instance with vm_state active and task_state reboot_started_hard.
Nov 08 18:54:48 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23432343864643835', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432343864643835', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1979140458',display_name='tempest-TestMinimumBasicScenario-server-1979140458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1979140458',id=44,image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMftBBI8Do7syVT0ExWaEfyhAaooQq0TQvwDDYzBqJirzEgdxmkWxu/xpkmMjc5KnpKv2/1O4sdaklmJfv0O4QCEQS6uKHKDyTjaDuGz9xM+grY0QKFmegoEO0pDz6qlvg==',key_name='tempest-TestMinimumBasicScenario-818040902',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-bpi90qfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:54:46Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=a8dd70f3-5cb8-4500-aaad-e5b68c9c6775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'pci_devices' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.objects.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Object Instance<a8dd70f3-5cb8-4500-aaad-e5b68c9c6775> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:54:48 user nova-compute[74820]:   <uuid>a8dd70f3-5cb8-4500-aaad-e5b68c9c6775</uuid>
Nov 08 18:54:48 user nova-compute[74820]:   <name>instance-0000002c</name>
Nov 08 18:54:48 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:54:48 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:54:48 user nova-compute[74820]:   <metadata>
Nov 08 18:54:48 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:54:48 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:54:48 user nova-compute[74820]:       <nova:name>tempest-TestMinimumBasicScenario-server-1979140458</nova:name>
Nov 08 18:54:48 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:54:47</nova:creationTime>
Nov 08 18:54:48 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:54:48 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:54:48 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:54:48 user nova-compute[74820]:       <nova:owner>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:user uuid="606ff562346743d89a203e59084fefcf">tempest-TestMinimumBasicScenario-1799886163-project-member</nova:user>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:project uuid="61ef84eead1b49079ef0ca885650e61e">tempest-TestMinimumBasicScenario-1799886163</nova:project>
Nov 08 18:54:48 user nova-compute[74820]:       </nova:owner>
Nov 08 18:54:48 user nova-compute[74820]:       <nova:root type="image" uuid="b4d6cd59-84ac-476e-9b3e-669ed21595ca"/>
Nov 08 18:54:48 user nova-compute[74820]:       <nova:ports>
Nov 08 18:54:48 user nova-compute[74820]:         <nova:port uuid="71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd">
Nov 08 18:54:48 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 18:54:48 user nova-compute[74820]:         </nova:port>
Nov 08 18:54:48 user nova-compute[74820]:       </nova:ports>
Nov 08 18:54:48 user nova-compute[74820]:     </nova:instance>
Nov 08 18:54:48 user nova-compute[74820]:   </metadata>
Nov 08 18:54:48 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:54:48 user nova-compute[74820]:     <system>
Nov 08 18:54:48 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:54:48 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:54:48 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:54:48 user nova-compute[74820]:       <entry name="serial">a8dd70f3-5cb8-4500-aaad-e5b68c9c6775</entry>
Nov 08 18:54:48 user nova-compute[74820]:       <entry name="uuid">a8dd70f3-5cb8-4500-aaad-e5b68c9c6775</entry>
Nov 08 18:54:48 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:54:48 user nova-compute[74820]:     </system>
Nov 08 18:54:48 user nova-compute[74820]:   </sysinfo>
Nov 08 18:54:48 user nova-compute[74820]:   <os>
Nov 08 18:54:48 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:54:48 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:54:48 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:54:48 user nova-compute[74820]:   </os>
Nov 08 18:54:48 user nova-compute[74820]:   <features>
Nov 08 18:54:48 user nova-compute[74820]:     <acpi/>
Nov 08 18:54:48 user nova-compute[74820]:     <apic/>
Nov 08 18:54:48 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:54:48 user nova-compute[74820]:   </features>
Nov 08 18:54:48 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:54:48 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:54:48 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:54:48 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:54:48 user nova-compute[74820]:   </clock>
Nov 08 18:54:48 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:54:48 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:54:48 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:54:48 user nova-compute[74820]:   </cpu>
Nov 08 18:54:48 user nova-compute[74820]:   <devices>
Nov 08 18:54:48 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:54:48 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:54:48 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk"/>
Nov 08 18:54:48 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:54:48 user nova-compute[74820]:     </disk>
Nov 08 18:54:48 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:54:48 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:54:48 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 18:54:48 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 18:54:48 user nova-compute[74820]:       <serial>bc9a44b4-9841-461a-a61b-5aff3114689a</serial>
Nov 08 18:54:48 user nova-compute[74820]:     </disk>
Nov 08 18:54:48 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:54:48 user nova-compute[74820]:       <mac address="fa:16:3e:a4:74:5b"/>
Nov 08 18:54:48 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:54:48 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:54:48 user nova-compute[74820]:       <target dev="tap71fbafbc-92"/>
Nov 08 18:54:48 user nova-compute[74820]:     </interface>
Nov 08 18:54:48 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:54:48 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/console.log" append="off"/>
Nov 08 18:54:48 user nova-compute[74820]:     </serial>
Nov 08 18:54:48 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:54:48 user nova-compute[74820]:     <video>
Nov 08 18:54:48 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:54:48 user nova-compute[74820]:     </video>
Nov 08 18:54:48 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:54:48 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:54:48 user nova-compute[74820]:     </rng>
Nov 08 18:54:48 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:54:48 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:54:48 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:54:48 user nova-compute[74820]:     </memballoon>
Nov 08 18:54:48 user nova-compute[74820]:   </devices>
Nov 08 18:54:48 user nova-compute[74820]: </domain>
Nov 08 18:54:48 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG nova.objects.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Object Instance<a8dd70f3-5cb8-4500-aaad-e5b68c9c6775> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:54:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Cannot resize image /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'migration_context' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.objects.base [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Object Instance<a8dd70f3-5cb8-4500-aaad-e5b68c9c6775> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1979140458',display_name='tempest-TestMinimumBasicScenario-server-1979140458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1979140458',id=44,image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMftBBI8Do7syVT0ExWaEfyhAaooQq0TQvwDDYzBqJirzEgdxmkWxu/xpkmMjc5KnpKv2/1O4sdaklmJfv0O4QCEQS6uKHKDyTjaDuGz9xM+grY0QKFmegoEO0pDz6qlvg==',key_name='tempest-TestMinimumBasicScenario-818040902',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-bpi90qfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:54:46Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=a8dd70f3-5cb8-4500-aaad-e5b68c9c6775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG os_vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '750bbc4f-b775-5547-80e5-64019d7d8999', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71fbafbc-92, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71fbafbc-92, col_values=(('qos', UUID('df692b0d-ec9c-4f56-bf78-2a229d37202c')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71fbafbc-92, col_values=(('external_ids', {'iface-id': '71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:74:5b', 'vm-uuid': 'a8dd70f3-5cb8-4500-aaad-e5b68c9c6775'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:54:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:49 user nova-compute[74820]: INFO os_vif [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92')
Nov 08 18:54:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-83289533-f717-4b81-8371-c4644d4baa48 req-38e43175-c522-4ca2-ba37-2a942a9def8c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83289533-f717-4b81-8371-c4644d4baa48 req-38e43175-c522-4ca2-ba37-2a942a9def8c service nova] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83289533-f717-4b81-8371-c4644d4baa48 req-38e43175-c522-4ca2-ba37-2a942a9def8c service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-83289533-f717-4b81-8371-c4644d4baa48 req-38e43175-c522-4ca2-ba37-2a942a9def8c service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-83289533-f717-4b81-8371-c4644d4baa48 req-38e43175-c522-4ca2-ba37-2a942a9def8c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] No waiting events found dispatching network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:51 user nova-compute[74820]: WARNING nova.compute.manager [req-83289533-f717-4b81-8371-c4644d4baa48 req-38e43175-c522-4ca2-ba37-2a942a9def8c service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received unexpected event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd for instance with vm_state active and task_state reboot_started_hard.
Nov 08 18:54:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:52 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:54:52 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance rebooted successfully.
Nov 08 18:54:52 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:54:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9cdd2f1c-751f-4d8d-812f-1443db649e90 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.646s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-4f5b1e04-66ac-44ef-9df8-f2a7aad4d12c req-afb0b681-b22d-43f1-97c8-b0243846c43a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:54:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4f5b1e04-66ac-44ef-9df8-f2a7aad4d12c req-afb0b681-b22d-43f1-97c8-b0243846c43a service nova] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4f5b1e04-66ac-44ef-9df8-f2a7aad4d12c req-afb0b681-b22d-43f1-97c8-b0243846c43a service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-4f5b1e04-66ac-44ef-9df8-f2a7aad4d12c req-afb0b681-b22d-43f1-97c8-b0243846c43a service nova] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:54:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-4f5b1e04-66ac-44ef-9df8-f2a7aad4d12c req-afb0b681-b22d-43f1-97c8-b0243846c43a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] No waiting events found dispatching network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:54:53 user nova-compute[74820]: WARNING nova.compute.manager [req-4f5b1e04-66ac-44ef-9df8-f2a7aad4d12c req-afb0b681-b22d-43f1-97c8-b0243846c43a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received unexpected event network-vif-plugged-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd for instance with vm_state active and task_state None.
Nov 08 18:54:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:54:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:54:57 user nova-compute[74820]: INFO nova.compute.manager [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Unshelving
Nov 08 18:54:58 user nova-compute[74820]: INFO nova.virt.block_device [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Booting with volume 71d88bb3-f4f6-466e-83a2-c65e8c17c66f at /dev/vda
Nov 08 18:54:58 user nova-compute[74820]: DEBUG os_brick.utils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3053ccac-1f79-42d7-b825-16479c45ba52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d581d34-54f4-4826-ab7e-f19b64941f6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c249f65-ea7b-44b0-98f3-eec14d9b5448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b81aa6-c75e-439c-8df3-ab1e32aeaf8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:54:58 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:54:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf35785-9493-44be-9ab5-038b4574a102]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG os_brick.utils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating existing volume attachment record: a0677529-7b72-4357-8b26-644fcb06502f {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:54:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:54:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:00 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:03 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:04 user nova-compute[74820]: INFO nova.compute.manager [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Unrescuing
Nov 08 18:55:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG nova.network.neutron [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG nova.network.neutron [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'flavor' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-475f9fcb-91e8-4db6-b2b8-5b6496400ae3 req-b4ddbaf9-1921-44b0-889e-e73b149ed74a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-475f9fcb-91e8-4db6-b2b8-5b6496400ae3 req-b4ddbaf9-1921-44b0-889e-e73b149ed74a service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-475f9fcb-91e8-4db6-b2b8-5b6496400ae3 req-b4ddbaf9-1921-44b0-889e-e73b149ed74a service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-475f9fcb-91e8-4db6-b2b8-5b6496400ae3 req-b4ddbaf9-1921-44b0-889e-e73b149ed74a service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-475f9fcb-91e8-4db6-b2b8-5b6496400ae3 req-b4ddbaf9-1921-44b0-889e-e73b149ed74a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:05 user nova-compute[74820]: WARNING nova.compute.manager [req-475f9fcb-91e8-4db6-b2b8-5b6496400ae3 req-b4ddbaf9-1921-44b0-889e-e73b149ed74a service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:55:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing instance network info cache due to event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG nova.network.neutron [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:06 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance destroyed successfully.
Nov 08 18:55:06 user nova-compute[74820]: DEBUG nova.network.neutron [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updated VIF entry in instance network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG nova.network.neutron [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b2e5d10c-70b5-4e12-b6ff-2dfd6e755809 req-66486272-95e3-4c6f-8ccb-d98ff861d33c service nova] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:07 user nova-compute[74820]: INFO nova.compute.manager [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Terminating instance
Nov 08 18:55:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-dc3c666b-5960-4e90-a69e-2d9a63bd0398 req-049c59e4-7b14-440e-b8e0-5ba7335d0883 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dc3c666b-5960-4e90-a69e-2d9a63bd0398 req-049c59e4-7b14-440e-b8e0-5ba7335d0883 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dc3c666b-5960-4e90-a69e-2d9a63bd0398 req-049c59e4-7b14-440e-b8e0-5ba7335d0883 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-dc3c666b-5960-4e90-a69e-2d9a63bd0398 req-049c59e4-7b14-440e-b8e0-5ba7335d0883 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-dc3c666b-5960-4e90-a69e-2d9a63bd0398 req-049c59e4-7b14-440e-b8e0-5ba7335d0883 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:07 user nova-compute[74820]: WARNING nova.compute.manager [req-dc3c666b-5960-4e90-a69e-2d9a63bd0398 req-049c59e4-7b14-440e-b8e0-5ba7335d0883 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-051d004c-bed9-4918-aa03-563e684db956 req-540a6e19-46bf-4a38-953e-fe116128d37b service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-051d004c-bed9-4918-aa03-563e684db956 req-540a6e19-46bf-4a38-953e-fe116128d37b service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-051d004c-bed9-4918-aa03-563e684db956 req-540a6e19-46bf-4a38-953e-fe116128d37b service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-051d004c-bed9-4918-aa03-563e684db956 req-540a6e19-46bf-4a38-953e-fe116128d37b service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-051d004c-bed9-4918-aa03-563e684db956 req-540a6e19-46bf-4a38-953e-fe116128d37b service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-051d004c-bed9-4918-aa03-563e684db956 req-540a6e19-46bf-4a38-953e-fe116128d37b service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-unplugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing instance network info cache due to event network-changed-3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Refreshing network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:55:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Instance destroyed successfully.
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'resources' on Instance uuid e3910a1a-aa2b-4dfc-ace7-6928fb2654e9 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1000166135',display_name='tempest-ServerRescueNegativeTestJSON-server-1000166135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1000166135',id=39,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObls43yFDmntriYPy6vbwWi0RmZvBHXny0HYOK3pRItq3z1rlG6Zz73KuEt48wSci6nbmbg5zxD1doyPrGdbPkuOOwLGB+TzMcQJ9g25ZjDmylTGJDQCiNejiVF8PSLxQ==',key_name='tempest-keypair-867934815',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:50:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-g2c7nad2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:52:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=e3910a1a-aa2b-4dfc-ace7-6928fb2654e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "address": "fa:16:3e:1c:9e:d2", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373a77bf-0c", "ovs_interfaceid": "373a77bf-0cb5-4375-a9c6-0f884f430b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG os_vif [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap373a77bf-0c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f583783f-2606-4b98-9f87-6185c294852c) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: INFO os_vif [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=373a77bf-0cb5-4375-a9c6-0f884f430b7a,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373a77bf-0c')
Nov 08 18:55:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Deleting instance files /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9_del
Nov 08 18:55:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Deletion of /opt/stack/data/nova/instances/e3910a1a-aa2b-4dfc-ace7-6928fb2654e9_del complete
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: INFO nova.compute.manager [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updated VIF entry in instance network info cache for port 3dd86d48-7b4f-4784-b80f-84e4f214f982. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-456e1cdc-e816-434c-92bb-14c8a67b16ff req-5deb7546-26f1-4412-9069-815c7d57ca67 service nova] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Skipping network cache update for instance because it is being deleted. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [{"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-2543db51-ac21-4c92-8df1-d8c31b93ddbb" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:09 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Took 0.99 seconds to deallocate network for instance.
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:09 user nova-compute[74820]: WARNING nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:09 user nova-compute[74820]: WARNING nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state rescued and task_state unrescuing.
Nov 08 18:55:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-3cfdcfc7-ce02-4f1e-a5b0-a2ebbef883c8 req-ce6879e1-283b-4c0d-8f99-3c1c1fac1ac2 service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-deleted-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-3c040e42-f924-45bf-ba33-2f591fea8a01 req-2f554ed4-68b0-4df4-9e94-dca5cb33804a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3c040e42-f924-45bf-ba33-2f591fea8a01 req-2f554ed4-68b0-4df4-9e94-dca5cb33804a service nova] Acquiring lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3c040e42-f924-45bf-ba33-2f591fea8a01 req-2f554ed4-68b0-4df4-9e94-dca5cb33804a service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3c040e42-f924-45bf-ba33-2f591fea8a01 req-2f554ed4-68b0-4df4-9e94-dca5cb33804a service nova] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG nova.compute.manager [req-3c040e42-f924-45bf-ba33-2f591fea8a01 req-2f554ed4-68b0-4df4-9e94-dca5cb33804a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] No waiting events found dispatching network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:10 user nova-compute[74820]: WARNING nova.compute.manager [req-3c040e42-f924-45bf-ba33-2f591fea8a01 req-2f554ed4-68b0-4df4-9e94-dca5cb33804a service nova] [instance: e3910a1a-aa2b-4dfc-ace7-6928fb2654e9] Received unexpected event network-vif-plugged-373a77bf-0cb5-4375-a9c6-0f884f430b7a for instance with vm_state deleted and task_state None.
Nov 08 18:55:10 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:10 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Deleted allocations for instance e3910a1a-aa2b-4dfc-ace7-6928fb2654e9
Nov 08 18:55:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f9b32707-0669-4541-8e7b-94f0bdb4d0e1 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "e3910a1a-aa2b-4dfc-ace7-6928fb2654e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7f23700d-4125-4ebc-aca6-03ebf3b6c0d7 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:55:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:55:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8249MB free_disk=24.9217529296875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance c006f656-bffe-4fd6-bb56-a4ec61defcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8a9be69a-983b-43ec-a502-dae853095928 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:55:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:55:23 user nova-compute[74820]: INFO nova.compute.claims [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Claim successful on node user
Nov 08 18:55:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:23 user nova-compute[74820]: INFO nova.network.neutron [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating port e8360bd0-89e0-4f0e-9a18-01775def3efa with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 18:55:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing instance network info cache due to event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:55:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Creating image(s)
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Did not create local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Ensure instance console log exists: /opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Start _get_guest_xml network_info=[{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'a0677529-7b72-4357-8b26-644fcb06502f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a9be69a-983b-43ec-a502-dae853095928', 'attached_at': '', 'detached_at': '', 'volume_id': '71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'serial': '71d88bb3-f4f6-466e-83a2-c65e8c17c66f'}, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.network.neutron [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:55:24 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:55:24 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.objects.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Object Instance<8a9be69a-983b-43ec-a502-dae853095928> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:55:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:55:25 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:55:25 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:55:25 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fee749-5410-4f2e-b9e6-e50943d9ce34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 18:55:25 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6e1273-0a30-44da-8ee3-e5976f860d2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f] added
Nov 08 18:55:25 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3517dac9-5525-4a9f-ba65-647d647f1a7c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86ff7c-373b-4733-b5d5-5fececa50d70]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmFLPqEa {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmFLPqEa" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc988959-47f5-4bb9-8498-bbeaeb54f032]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmFLPqEa'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10dc275-f152-4f5c-a73f-159af6dc78b8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[110a3d45-a967-4f62-b014-cb225e9e0851]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:25 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:25 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f901c-4c4b-452f-9026-f5106848aa0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]
Nov 08 18:55:25 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.
Nov 08 18:55:25 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b6bbf-fb51-4539-82ed-12fd9dcad4e2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb9d053-16cb-4f9a-a9e4-0adf5596a478]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:55:25 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:25 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:55:25 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb457da-bc30-4bcc-87ff-42767df1f2b3]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updated VIF entry in instance network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6efc32a3-9a46-462a-b91c-8b350c96ca22 req-5eec24a7-3cb8-4824-83be-c369cfe8d37b service nova] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-changed-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Refreshing instance network info cache due to event network-changed-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] Acquiring lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] Acquired lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.network.neutron [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Refreshing network info cache for port 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23537626439626263', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626439626263', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1353245481',display_name='tempest-TestShelveInstance-server-1353245481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1353245481',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-950946572',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='26b5a8f5964e4c988c7e54a51dc8be27',ramdisk_id='',reservation_id='r-q9p9zb3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1981518489',owner_user_name='tempest-TestShelveInstance-1981518489-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:54:58Z,user_data=None,user_id='c758b51fdce147f2b8ab6f7994398b76',uuid=8a9be69a-983b-43ec-a502-dae853095928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converting VIF {"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.objects.base [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Object Instance<8a9be69a-983b-43ec-a502-dae853095928> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:55:26 user nova-compute[74820]:   <uuid>8a9be69a-983b-43ec-a502-dae853095928</uuid>
Nov 08 18:55:26 user nova-compute[74820]:   <name>instance-0000002b</name>
Nov 08 18:55:26 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:55:26 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:55:26 user nova-compute[74820]:   <metadata>
Nov 08 18:55:26 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:55:26 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:55:26 user nova-compute[74820]:       <nova:name>tempest-TestShelveInstance-server-1353245481</nova:name>
Nov 08 18:55:26 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:55:24</nova:creationTime>
Nov 08 18:55:26 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:55:26 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:55:26 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:55:26 user nova-compute[74820]:       <nova:owner>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:user uuid="c758b51fdce147f2b8ab6f7994398b76">tempest-TestShelveInstance-1981518489-project-member</nova:user>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:project uuid="26b5a8f5964e4c988c7e54a51dc8be27">tempest-TestShelveInstance-1981518489</nova:project>
Nov 08 18:55:26 user nova-compute[74820]:       </nova:owner>
Nov 08 18:55:26 user nova-compute[74820]:       <nova:ports>
Nov 08 18:55:26 user nova-compute[74820]:         <nova:port uuid="e8360bd0-89e0-4f0e-9a18-01775def3efa">
Nov 08 18:55:26 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 18:55:26 user nova-compute[74820]:         </nova:port>
Nov 08 18:55:26 user nova-compute[74820]:       </nova:ports>
Nov 08 18:55:26 user nova-compute[74820]:     </nova:instance>
Nov 08 18:55:26 user nova-compute[74820]:   </metadata>
Nov 08 18:55:26 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:55:26 user nova-compute[74820]:     <system>
Nov 08 18:55:26 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:55:26 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:55:26 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:55:26 user nova-compute[74820]:       <entry name="serial">8a9be69a-983b-43ec-a502-dae853095928</entry>
Nov 08 18:55:26 user nova-compute[74820]:       <entry name="uuid">8a9be69a-983b-43ec-a502-dae853095928</entry>
Nov 08 18:55:26 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:55:26 user nova-compute[74820]:     </system>
Nov 08 18:55:26 user nova-compute[74820]:   </sysinfo>
Nov 08 18:55:26 user nova-compute[74820]:   <os>
Nov 08 18:55:26 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:55:26 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:55:26 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:55:26 user nova-compute[74820]:   </os>
Nov 08 18:55:26 user nova-compute[74820]:   <features>
Nov 08 18:55:26 user nova-compute[74820]:     <acpi/>
Nov 08 18:55:26 user nova-compute[74820]:     <apic/>
Nov 08 18:55:26 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:55:26 user nova-compute[74820]:   </features>
Nov 08 18:55:26 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:55:26 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:55:26 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:55:26 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:55:26 user nova-compute[74820]:   </clock>
Nov 08 18:55:26 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:55:26 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:55:26 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:55:26 user nova-compute[74820]:   </cpu>
Nov 08 18:55:26 user nova-compute[74820]:   <devices>
Nov 08 18:55:26 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 18:55:26 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:55:26 user nova-compute[74820]:       <source dev="/dev/sdc"/>
Nov 08 18:55:26 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:55:26 user nova-compute[74820]:       <serial>71d88bb3-f4f6-466e-83a2-c65e8c17c66f</serial>
Nov 08 18:55:26 user nova-compute[74820]:     </disk>
Nov 08 18:55:26 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:55:26 user nova-compute[74820]:       <mac address="fa:16:3e:2d:f2:66"/>
Nov 08 18:55:26 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:55:26 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:55:26 user nova-compute[74820]:       <target dev="tape8360bd0-89"/>
Nov 08 18:55:26 user nova-compute[74820]:     </interface>
Nov 08 18:55:26 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:55:26 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928/console.log" append="off"/>
Nov 08 18:55:26 user nova-compute[74820]:     </serial>
Nov 08 18:55:26 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:55:26 user nova-compute[74820]:     <video>
Nov 08 18:55:26 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:55:26 user nova-compute[74820]:     </video>
Nov 08 18:55:26 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:55:26 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:55:26 user nova-compute[74820]:     </rng>
Nov 08 18:55:26 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:55:26 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:55:26 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:55:26 user nova-compute[74820]:     </memballoon>
Nov 08 18:55:26 user nova-compute[74820]:   </devices>
Nov 08 18:55:26 user nova-compute[74820]: </domain>
Nov 08 18:55:26 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1353245481',display_name='tempest-TestShelveInstance-server-1353245481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1353245481',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-950946572',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='26b5a8f5964e4c988c7e54a51dc8be27',ramdisk_id='',reservation_id='r-q9p9zb3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1981518489',owner_user_name='tempest-TestShelveInstance-1981518489-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:54:58Z,user_data=None,user_id='c758b51fdce147f2b8ab6f7994398b76',uuid=8a9be69a-983b-43ec-a502-dae853095928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converting VIF {"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG os_vif [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c766880b-a747-5216-87ab-7525c151647f', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8360bd0-89, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8360bd0-89, col_values=(('qos', UUID('2b257dd4-3bd1-4f0b-b99d-de5f3e148445')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8360bd0-89, col_values=(('external_ids', {'iface-id': 'e8360bd0-89e0-4f0e-9a18-01775def3efa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:66', 'vm-uuid': '8a9be69a-983b-43ec-a502-dae853095928'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: INFO os_vif [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89')
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:26 user nova-compute[74820]: INFO nova.compute.manager [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Terminating instance
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] No VIF found with MAC fa:16:3e:2d:f2:66, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updated VIF entry in instance network info cache for port 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:55:27 user nova-compute[74820]: DEBUG nova.network.neutron [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating instance_info_cache with network_info: [{"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:27 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2bb63906-d66c-4d98-90f5-d9f2345e6b6f req-3f534674-c937-4c26-a77f-460418bdb3e9 service nova] Releasing lock "refresh_cache-dc9c5a40-7fb2-4982-81e4-17a634a05bce" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Instance destroyed successfully.
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lazy-loading 'resources' on Instance uuid dc9c5a40-7fb2-4982-81e4-17a634a05bce {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155071083',display_name='tempest-TestVolumeBootPattern-server-155071083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155071083',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLZKSxoPRzmzpuOiUjcp0GFXbZrJLNC8rQMZLoY1t2fGXsZRlnZ5niYiMxadj7m5SHq6yXzf4rfAgoP6leirKJ+mU/HHmbVz3Jz3bgFX/m3sSPXpDrwXtHPTps917Y4g==',key_name='tempest-TestVolumeBootPattern-1503054205',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:50:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2ad38240d754655a8f23b1dbc581507',ramdisk_id='',reservation_id='r-aurbptq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1148056077',owner_user_name='tempest-TestVolumeBootPattern-1148056077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:50:37Z,user_data=None,user_id='4d80baca13c04f37b8ea3d651536cdfd',uuid=dc9c5a40-7fb2-4982-81e4-17a634a05bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converting VIF {"id": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "address": "fa:16:3e:c1:88:b8", "network": {"id": "6d0a268e-ec63-4eb0-a148-39d7d9c7d917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-187277383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2ad38240d754655a8f23b1dbc581507", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ee0a-6a", "ovs_interfaceid": "39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_vif [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39f6ee0a-6a, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2714b040-ff31-4614-8ad7-aa190a640d9e) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: INFO os_vif [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a,network=Network(6d0a268e-ec63-4eb0-a148-39d7d9c7d917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ee0a-6a')
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrJWgEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:55:28 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb3521-3063-4431-983d-e7d69c312518]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:55:28 user nova-compute[74820]: No targets found.
Nov 08 18:55:28 user nova-compute[74820]: iSNS:
Nov 08 18:55:28 user nova-compute[74820]: No targets found.
Nov 08 18:55:28 user nova-compute[74820]: STATIC:
Nov 08 18:55:28 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f
Nov 08 18:55:28 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:28 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:28 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:55:28 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:28 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:28 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff
Nov 08 18:55:28 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:28 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:28 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:55:28 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:28 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:28 user nova-compute[74820]: FIRMWARE:
Nov 08 18:55:28 user nova-compute[74820]: No targets found.
Nov 08 18:55:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:55:28 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:55:28 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf247ac6-5aa1-4acd-a847-e25df7d47b5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448f5a3-acc8-4680-be8b-7f291975dff4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:55:28 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:28 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:28 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:55:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff (non-flash)
Nov 08 18:55:28 user nova-compute[74820]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:28 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:28 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:55:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e281d88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff'): ({'sdd'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Removing single pathed devices sdd {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab246b40-7a81-4d51-99d7-92337640425f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2dbd64-a573-4d60-88cd-5ab7322d531f]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Flushing IO for device /dev/sdd {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-538769dd-f50b-4af2-8f64-5f40e3f335bf req-75f0ff59-ba3e-468a-8205-ee00ec180a10 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-538769dd-f50b-4af2-8f64-5f40e3f335bf req-75f0ff59-ba3e-468a-8205-ee00ec180a10 service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-538769dd-f50b-4af2-8f64-5f40e3f335bf req-75f0ff59-ba3e-468a-8205-ee00ec180a10 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-538769dd-f50b-4af2-8f64-5f40e3f335bf req-75f0ff59-ba3e-468a-8205-ee00ec180a10 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-538769dd-f50b-4af2-8f64-5f40e3f335bf req-75f0ff59-ba3e-468a-8205-ee00ec180a10 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:28 user nova-compute[74820]: WARNING nova.compute.manager [req-538769dd-f50b-4af2-8f64-5f40e3f335bf req-75f0ff59-ba3e-468a-8205-ee00ec180a10 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1082b421-3703-4331-b540-73f8d69b3911]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[181fcfb0-5509-42d1-b7f9-751500033481]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] SCSI volumes sdd have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-vif-unplugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] No waiting events found dispatching network-vif-unplugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-vif-unplugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] Acquiring lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] No waiting events found dispatching network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:28 user nova-compute[74820]: WARNING nova.compute.manager [req-978f7fff-6713-4d4e-94cb-c20cf755d688 req-f63b173e-723f-470d-a73a-0f03a8a16867 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received unexpected event network-vif-plugged-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a for instance with vm_state active and task_state deleting.
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8709ca37-fcc8-4cd8-a393-8ac32b2d3142]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9847a-0c04-412f-8d89-ba662f37e9ac]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260]
Nov 08 18:55:28 user nova-compute[74820]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff, portal: 172.16.0.220,3260] successful.
Nov 08 18:55:28 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f683e58-9068-43fb-82a3-550a535c49ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb0676f-12d9-4d14-b39e-c6c9c908de1f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] <== disconnect_volume: return (390ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:55:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Deleting instance files /opt/stack/data/nova/instances/dc9c5a40-7fb2-4982-81e4-17a634a05bce_del
Nov 08 18:55:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Deletion of /opt/stack/data/nova/instances/dc9c5a40-7fb2-4982-81e4-17a634a05bce_del complete
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: INFO nova.compute.manager [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Took 2.35 seconds to destroy the instance on the hypervisor.
Nov 08 18:55:28 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:29 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-2620089c-1789-4274-96f5-137a80ac0495 req-b4c81cd3-c466-4bc2-a821-043d38199f85 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Received event network-vif-deleted-39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:29 user nova-compute[74820]: INFO nova.compute.manager [req-2620089c-1789-4274-96f5-137a80ac0495 req-b4c81cd3-c466-4bc2-a821-043d38199f85 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Neutron deleted interface 39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a; detaching it from the instance and deleting it from the info cache
Nov 08 18:55:29 user nova-compute[74820]: DEBUG nova.network.neutron [req-2620089c-1789-4274-96f5-137a80ac0495 req-b4c81cd3-c466-4bc2-a821-043d38199f85 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:55:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-2620089c-1789-4274-96f5-137a80ac0495 req-b4c81cd3-c466-4bc2-a821-043d38199f85 service nova] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Detach interface failed, port_id=39f6ee0a-6a79-4bcf-8ebe-0054db5ff52a, reason: Instance dc9c5a40-7fb2-4982-81e4-17a634a05bce could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:55:29 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Took 0.48 seconds to deallocate network for instance.
Nov 08 18:55:30 user nova-compute[74820]: INFO nova.compute.manager [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] [instance: dc9c5a40-7fb2-4982-81e4-17a634a05bce] Took 0.88 seconds to detach 1 volumes for instance.
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-b320db85-82cb-48ff-9169-ad4216821885 req-54d5cca8-2fe6-4b8d-ab39-3465ae88bcac service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b320db85-82cb-48ff-9169-ad4216821885 req-54d5cca8-2fe6-4b8d-ab39-3465ae88bcac service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b320db85-82cb-48ff-9169-ad4216821885 req-54d5cca8-2fe6-4b8d-ab39-3465ae88bcac service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b320db85-82cb-48ff-9169-ad4216821885 req-54d5cca8-2fe6-4b8d-ab39-3465ae88bcac service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-b320db85-82cb-48ff-9169-ad4216821885 req-54d5cca8-2fe6-4b8d-ab39-3465ae88bcac service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:55:30 user nova-compute[74820]: WARNING nova.compute.manager [req-b320db85-82cb-48ff-9169-ad4216821885 req-54d5cca8-2fe6-4b8d-ab39-3465ae88bcac service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:55:30 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance spawned successfully.
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:30 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Deleted allocations for instance dc9c5a40-7fb2-4982-81e4-17a634a05bce
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1d703cc9-1af4-4d48-9d95-0529be392b0e tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 32.569s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9976504d-1e83-430e-b002-2cdaf2a77d04 tempest-TestVolumeBootPattern-1148056077 tempest-TestVolumeBootPattern-1148056077-project-member] Lock "dc9c5a40-7fb2-4982-81e4-17a634a05bce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.160s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:55:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:55:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:55:37 user nova-compute[74820]: INFO nova.compute.manager [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Detaching volume 5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:55:38 user nova-compute[74820]: INFO nova.virt.block_device [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Attempting to driver detach volume 5eb41cce-44a4-400c-b0cf-b9c2e689153d from mountpoint /dev/vdb
Nov 08 18:55:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Attempting to detach device vdb from instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:55:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:55:38 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:55:38 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:55:38 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:55:38 user nova-compute[74820]:   <serial>5eb41cce-44a4-400c-b0cf-b9c2e689153d</serial>
Nov 08 18:55:38 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:55:38 user nova-compute[74820]: </disk>
Nov 08 18:55:38 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:55:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Successfully detached device vdb from instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb from the persistent domain config.
Nov 08 18:55:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:55:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:55:38 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:55:38 user nova-compute[74820]:   <source dev="/dev/sde"/>
Nov 08 18:55:38 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:55:38 user nova-compute[74820]:   <serial>5eb41cce-44a4-400c-b0cf-b9c2e689153d</serial>
Nov 08 18:55:38 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 18:55:38 user nova-compute[74820]: </disk>
Nov 08 18:55:38 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:55:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:55:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:58 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb is timed out.
Nov 08 18:55:58 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Successfully detached device vdb from instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb from the live domain config.
Nov 08 18:55:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHebqBuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:55:58 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[64902409-c588-41d0-8c37-f17bbbd800fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:55:58 user nova-compute[74820]: No targets found.
Nov 08 18:55:58 user nova-compute[74820]: iSNS:
Nov 08 18:55:58 user nova-compute[74820]: No targets found.
Nov 08 18:55:58 user nova-compute[74820]: STATIC:
Nov 08 18:55:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f
Nov 08 18:55:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:55:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:58 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d
Nov 08 18:55:58 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:55:58 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:55:58 user nova-compute[74820]: FIRMWARE:
Nov 08 18:55:58 user nova-compute[74820]: No targets found.
Nov 08 18:55:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:55:58 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:55:58 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8056c1-b34e-4516-9e41-bf257360b98c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2fe3b-215a-46ee-a0f6-26963ff28b56]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:58 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:58 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:55:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d (non-flash)
Nov 08 18:55:58 user nova-compute[74820]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:55:58 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:55:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e40131f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d'): ({'sde'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Removing single pathed devices sde {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6758eb-1a7b-478b-9988-6785041d6b3b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[378e0fa1-78d9-4d54-9494-c677d0d146cb]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Flushing IO for device /dev/sde {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf8fdd-b95a-4718-ac2b-e210f1c9fe25]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a25722-47dd-47e7-8bbf-6602213a1f78]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] SCSI volumes sde have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e474e5a-3eb6-4496-bb45-90c718d6b425]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4617e5-0e36-4395-b628-9182819c44af]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260]
Nov 08 18:55:58 user nova-compute[74820]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d, portal: 172.16.0.220,3260] successful.
Nov 08 18:55:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eb41cce-44a4-400c-b0cf-b9c2e689153d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd62951-5f4d-4d65-8c3f-c7f71b91a704]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] <== disconnect_volume: return (417ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:55:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:55:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:55:59 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'flavor' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:56:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c16db9ec-44c3-45d8-afae-4966659fea21 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.074s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:03 user nova-compute[74820]: INFO nova.compute.manager [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Terminating instance
Nov 08 18:56:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-fb01a268-df9c-486b-bcad-f596b002ae97 req-45ad8a2c-d1fd-49a1-9cae-2f9fcdba7c35 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-vif-unplugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fb01a268-df9c-486b-bcad-f596b002ae97 req-45ad8a2c-d1fd-49a1-9cae-2f9fcdba7c35 service nova] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fb01a268-df9c-486b-bcad-f596b002ae97 req-45ad8a2c-d1fd-49a1-9cae-2f9fcdba7c35 service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fb01a268-df9c-486b-bcad-f596b002ae97 req-45ad8a2c-d1fd-49a1-9cae-2f9fcdba7c35 service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-fb01a268-df9c-486b-bcad-f596b002ae97 req-45ad8a2c-d1fd-49a1-9cae-2f9fcdba7c35 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] No waiting events found dispatching network-vif-unplugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-fb01a268-df9c-486b-bcad-f596b002ae97 req-45ad8a2c-d1fd-49a1-9cae-2f9fcdba7c35 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-vif-unplugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:56:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Instance destroyed successfully.
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.objects.instance [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lazy-loading 'resources' on Instance uuid c006f656-bffe-4fd6-bb56-a4ec61defcc6 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2062926124',display_name='tempest-VolumesActionsTest-instance-2062926124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2062926124',id=46,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:54:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6925f3775d044967a0b31b1612874953',ramdisk_id='',reservation_id='r-kg74f90j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1829984437',owner_user_name='tempest-VolumesActionsTest-1829984437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:54:01Z,user_data=None,user_id='3dcc24a397d24301945b28fa99f71e3d',uuid=c006f656-bffe-4fd6-bb56-a4ec61defcc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Converting VIF {"id": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "address": "fa:16:3e:8e:7d:ed", "network": {"id": "2d873625-afed-4d2c-a1ea-ba659a8442a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-151849855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6925f3775d044967a0b31b1612874953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cc03a4-2f", "ovs_interfaceid": "57cc03a4-2f5b-4427-a321-bd703cacc8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG os_vif [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57cc03a4-2f, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27dfc7ac-d07a-469d-bce9-adfde434f91f) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:04 user nova-compute[74820]: INFO os_vif [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7d:ed,bridge_name='br-int',has_traffic_filtering=True,id=57cc03a4-2f5b-4427-a321-bd703cacc8a5,network=Network(2d873625-afed-4d2c-a1ea-ba659a8442a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cc03a4-2f')
Nov 08 18:56:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Deleting instance files /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6_del
Nov 08 18:56:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Deletion of /opt/stack/data/nova/instances/c006f656-bffe-4fd6-bb56-a4ec61defcc6_del complete
Nov 08 18:56:04 user nova-compute[74820]: INFO nova.compute.manager [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 08 18:56:04 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:04 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Took 0.56 seconds to deallocate network for instance.
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-85dce136-20bc-4ace-a4d8-7ef125470e03 req-97ebafef-19e7-4523-9eb8-017667b5e9f5 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-vif-deleted-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:56:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:05 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Deleted allocations for instance c006f656-bffe-4fd6-bb56-a4ec61defcc6
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-eaef8b5b-e608-40c0-8980-3f6ecc95e8f0 tempest-VolumesActionsTest-1829984437 tempest-VolumesActionsTest-1829984437-project-member] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.674s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-7abc159e-f714-44ca-b804-170663879fc4 req-2d3ed515-69f0-4c4f-990d-0ec00b2ed036 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received event network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7abc159e-f714-44ca-b804-170663879fc4 req-2d3ed515-69f0-4c4f-990d-0ec00b2ed036 service nova] Acquiring lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7abc159e-f714-44ca-b804-170663879fc4 req-2d3ed515-69f0-4c4f-990d-0ec00b2ed036 service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7abc159e-f714-44ca-b804-170663879fc4 req-2d3ed515-69f0-4c4f-990d-0ec00b2ed036 service nova] Lock "c006f656-bffe-4fd6-bb56-a4ec61defcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-7abc159e-f714-44ca-b804-170663879fc4 req-2d3ed515-69f0-4c4f-990d-0ec00b2ed036 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] No waiting events found dispatching network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:05 user nova-compute[74820]: WARNING nova.compute.manager [req-7abc159e-f714-44ca-b804-170663879fc4 req-2d3ed515-69f0-4c4f-990d-0ec00b2ed036 service nova] [instance: c006f656-bffe-4fd6-bb56-a4ec61defcc6] Received unexpected event network-vif-plugged-57cc03a4-2f5b-4427-a321-bd703cacc8a5 for instance with vm_state deleted and task_state None.
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:56:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:56:10 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:56:10 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:56:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:56:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:56:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:56:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:16 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:56:16 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8297MB free_disk=24.946422576904297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 195fa78f-a73f-494e-b95b-41b5061326b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 8a9be69a-983b-43ec-a502-dae853095928 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:56:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:28 user nova-compute[74820]: INFO nova.compute.manager [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Terminating instance
Nov 08 18:56:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cda3f47-9b39-4e0a-b486-fa5783b518d8 req-580e3414-780d-4cfb-803f-12724b64cf5c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cda3f47-9b39-4e0a-b486-fa5783b518d8 req-580e3414-780d-4cfb-803f-12724b64cf5c service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cda3f47-9b39-4e0a-b486-fa5783b518d8 req-580e3414-780d-4cfb-803f-12724b64cf5c service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cda3f47-9b39-4e0a-b486-fa5783b518d8 req-580e3414-780d-4cfb-803f-12724b64cf5c service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cda3f47-9b39-4e0a-b486-fa5783b518d8 req-580e3414-780d-4cfb-803f-12724b64cf5c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cda3f47-9b39-4e0a-b486-fa5783b518d8 req-580e3414-780d-4cfb-803f-12724b64cf5c service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-unplugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Instance destroyed successfully.
Nov 08 18:56:29 user nova-compute[74820]: DEBUG nova.objects.instance [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lazy-loading 'resources' on Instance uuid 2543db51-ac21-4c92-8df1-d8c31b93ddbb {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1420271536',display_name='tempest-ServerStableDeviceRescueTest-server-1420271536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1420271536',id=41,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM48eOi6v215srLN0TaqER5lRThokE6vti/AYowdlQxrwjHvAkaWKxfp+gH7Q25LzcqmiSFzRM2hIi6SdO7U0kWFfGvjRUPCqvLepecHDyaouFOMz+vfmyQ//+3+L1cvRA==',key_name='tempest-keypair-976236889',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d6dbf427cb540cda851042887350b47',ramdisk_id='',reservation_id='r-rf62ozlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1586196320',owner_user_name='tempest-ServerStableDeviceRescueTest-1586196320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7487b21f1a7d456a879d0911ff2b8b7e',uuid=2543db51-ac21-4c92-8df1-d8c31b93ddbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converting VIF {"id": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "address": "fa:16:3e:e2:24:d1", "network": {"id": "278f798c-e2b7-4366-a5ab-8e3031809414", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-430541940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6dbf427cb540cda851042887350b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd86d48-7b", "ovs_interfaceid": "3dd86d48-7b4f-4784-b80f-84e4f214f982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG os_vif [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd86d48-7b, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fca149b-c3f7-4619-82f7-04fe68324851) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:29 user nova-compute[74820]: INFO os_vif [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:24:d1,bridge_name='br-int',has_traffic_filtering=True,id=3dd86d48-7b4f-4784-b80f-84e4f214f982,network=Network(278f798c-e2b7-4366-a5ab-8e3031809414),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd86d48-7b')
Nov 08 18:56:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Deleting instance files /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb_del
Nov 08 18:56:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Deletion of /opt/stack/data/nova/instances/2543db51-ac21-4c92-8df1-d8c31b93ddbb_del complete
Nov 08 18:56:29 user nova-compute[74820]: INFO nova.compute.manager [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 18:56:29 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:56:29 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:30 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Took 0.81 seconds to deallocate network for instance.
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:30 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Deleted allocations for instance 2543db51-ac21-4c92-8df1-d8c31b93ddbb
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-a43d8225-cfc6-4473-947b-76f800ab9210 tempest-ServerStableDeviceRescueTest-1586196320 tempest-ServerStableDeviceRescueTest-1586196320-project-member] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] Acquiring lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] Lock "2543db51-ac21-4c92-8df1-d8c31b93ddbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] No waiting events found dispatching network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:30 user nova-compute[74820]: WARNING nova.compute.manager [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received unexpected event network-vif-plugged-3dd86d48-7b4f-4784-b80f-84e4f214f982 for instance with vm_state deleted and task_state None.
Nov 08 18:56:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-7e819790-c4c9-4e28-9196-89ae38393c32 req-6523f28d-2eae-427c-99c0-8646b22e886d service nova] [instance: 2543db51-ac21-4c92-8df1-d8c31b93ddbb] Received event network-vif-deleted-3dd86d48-7b4f-4784-b80f-84e4f214f982 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing instance network info cache due to event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:56:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:56:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:56:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:56:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updated VIF entry in instance network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:56:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-685699ed-c786-4492-bd8f-cd0c5497a2bf req-2ec8ba20-b20b-4908-b989-db984289716a service nova] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:56:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing instance network info cache due to event network-changed-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.network.neutron [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Refreshing network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:39 user nova-compute[74820]: INFO nova.compute.manager [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Detaching volume bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:56:39 user nova-compute[74820]: INFO nova.virt.block_device [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Attempting to driver detach volume bc9a44b4-9841-461a-a61b-5aff3114689a from mountpoint /dev/vdb
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Attempting to detach device vdb from instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:56:39 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:56:39 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:56:39 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:56:39 user nova-compute[74820]:   <serial>bc9a44b4-9841-461a-a61b-5aff3114689a</serial>
Nov 08 18:56:39 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 18:56:39 user nova-compute[74820]: </disk>
Nov 08 18:56:39 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:56:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully detached device vdb from instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 from the persistent domain config.
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 18:56:39 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 18:56:39 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 18:56:39 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 18:56:39 user nova-compute[74820]:   <serial>bc9a44b4-9841-461a-a61b-5aff3114689a</serial>
Nov 08 18:56:39 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 18:56:39 user nova-compute[74820]: </disk>
Nov 08 18:56:39 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.network.neutron [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updated VIF entry in instance network info cache for port 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.network.neutron [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-01876d54-1b46-4553-ac10-0d92adef359e req-00f78060-eb1d-4140-af18-8b1e63d824e7 service nova] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:39 user nova-compute[74820]: INFO nova.compute.manager [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Terminating instance
Nov 08 18:56:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:56:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-7afe3ad4-4e77-4fc8-920f-c8ca8f0b324b req-d4974e96-534c-4f1c-b351-28cf302a8d9c service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-unplugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7afe3ad4-4e77-4fc8-920f-c8ca8f0b324b req-d4974e96-534c-4f1c-b351-28cf302a8d9c service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7afe3ad4-4e77-4fc8-920f-c8ca8f0b324b req-d4974e96-534c-4f1c-b351-28cf302a8d9c service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7afe3ad4-4e77-4fc8-920f-c8ca8f0b324b req-d4974e96-534c-4f1c-b351-28cf302a8d9c service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-7afe3ad4-4e77-4fc8-920f-c8ca8f0b324b req-d4974e96-534c-4f1c-b351-28cf302a8d9c service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-unplugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-7afe3ad4-4e77-4fc8-920f-c8ca8f0b324b req-d4974e96-534c-4f1c-b351-28cf302a8d9c service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-unplugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Instance destroyed successfully.
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'resources' on Instance uuid 195fa78f-a73f-494e-b95b-41b5061326b2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-73105212',display_name='tempest-ServerRescueNegativeTestJSON-server-73105212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-73105212',id=27,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:40:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-icw14c7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:40:19Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=195fa78f-a73f-494e-b95b-41b5061326b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "address": "fa:16:3e:17:b6:1d", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffbecd7-0e", "ovs_interfaceid": "dffbecd7-0e8c-4bba-bb02-ac23604ded73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG os_vif [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdffbecd7-0e, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63351e63-4d4d-4d27-8fc3-dd2687e72d0a) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:40 user nova-compute[74820]: INFO os_vif [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b6:1d,bridge_name='br-int',has_traffic_filtering=True,id=dffbecd7-0e8c-4bba-bb02-ac23604ded73,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffbecd7-0e')
Nov 08 18:56:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Deleting instance files /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2_del
Nov 08 18:56:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Deletion of /opt/stack/data/nova/instances/195fa78f-a73f-494e-b95b-41b5061326b2_del complete
Nov 08 18:56:40 user nova-compute[74820]: INFO nova.compute.manager [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 08 18:56:40 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:56:40 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:56:41 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:41 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Took 0.54 seconds to deallocate network for instance.
Nov 08 18:56:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-be472db2-c7da-47c0-86e1-b7b57b3dbc5c req-6b38434f-b32c-4811-9998-bf2f34b04887 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-deleted-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:41 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:56:41 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:56:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:41 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Deleted allocations for instance 195fa78f-a73f-494e-b95b-41b5061326b2
Nov 08 18:56:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0c95e277-5639-422b-955c-3d517e08ab74 tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "195fa78f-a73f-494e-b95b-41b5061326b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.602s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-0cc59f0f-c2d8-419f-afdc-b9bd43b3892f req-ee159818-c1be-4b84-95b3-db07e20b24a0 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0cc59f0f-c2d8-419f-afdc-b9bd43b3892f req-ee159818-c1be-4b84-95b3-db07e20b24a0 service nova] Acquiring lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0cc59f0f-c2d8-419f-afdc-b9bd43b3892f req-ee159818-c1be-4b84-95b3-db07e20b24a0 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0cc59f0f-c2d8-419f-afdc-b9bd43b3892f req-ee159818-c1be-4b84-95b3-db07e20b24a0 service nova] Lock "195fa78f-a73f-494e-b95b-41b5061326b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-0cc59f0f-c2d8-419f-afdc-b9bd43b3892f req-ee159818-c1be-4b84-95b3-db07e20b24a0 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] No waiting events found dispatching network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:42 user nova-compute[74820]: WARNING nova.compute.manager [req-0cc59f0f-c2d8-419f-afdc-b9bd43b3892f req-ee159818-c1be-4b84-95b3-db07e20b24a0 service nova] [instance: 195fa78f-a73f-494e-b95b-41b5061326b2] Received unexpected event network-vif-plugged-dffbecd7-0e8c-4bba-bb02-ac23604ded73 for instance with vm_state deleted and task_state None.
Nov 08 18:56:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing instance network info cache due to event network-changed-e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] Acquiring lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] Acquired lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG nova.network.neutron [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Refreshing network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:48 user nova-compute[74820]: INFO nova.compute.manager [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Terminating instance
Nov 08 18:56:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-da436c80-8852-46d3-af28-7cb27d74b7b0 req-5b917353-0a5c-4420-9e22-4cc330f5602d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-unplugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-da436c80-8852-46d3-af28-7cb27d74b7b0 req-5b917353-0a5c-4420-9e22-4cc330f5602d service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-da436c80-8852-46d3-af28-7cb27d74b7b0 req-5b917353-0a5c-4420-9e22-4cc330f5602d service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-da436c80-8852-46d3-af28-7cb27d74b7b0 req-5b917353-0a5c-4420-9e22-4cc330f5602d service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-da436c80-8852-46d3-af28-7cb27d74b7b0 req-5b917353-0a5c-4420-9e22-4cc330f5602d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-unplugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-da436c80-8852-46d3-af28-7cb27d74b7b0 req-5b917353-0a5c-4420-9e22-4cc330f5602d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-unplugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:56:49 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Instance destroyed successfully.
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.objects.instance [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lazy-loading 'resources' on Instance uuid 8a9be69a-983b-43ec-a502-dae853095928 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T18:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1353245481',display_name='tempest-TestShelveInstance-server-1353245481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1353245481',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkQeOCrHm4DeWV0ReOpyBBKHDRGG2LNQ+7HAZLFkWagpY7jeDe2Tl2v/QsVMJggRUjBItFsgbrgxBRj8h+TA9k0J+3SB6CtANG6A5CgZa6++QROI81d7dVFAHZcNoLh6w==',key_name='tempest-TestShelveInstance-950946572',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:55:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26b5a8f5964e4c988c7e54a51dc8be27',ramdisk_id='',reservation_id='r-q9p9zb3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1981518489',owner_user_name='tempest-TestShelveInstance-1981518489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:55:31Z,user_data=None,user_id='c758b51fdce147f2b8ab6f7994398b76',uuid=8a9be69a-983b-43ec-a502-dae853095928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converting VIF {"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_vif [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8360bd0-89, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b257dd4-3bd1-4f0b-b99d-de5f3e148445) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:56:49 user nova-compute[74820]: INFO os_vif [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=e8360bd0-89e0-4f0e-9a18-01775def3efa,network=Network(f00078ff-e5dc-4bae-910a-c7f15cb71b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8360bd0-89')
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmFLPqEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:56:49 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e445c-31ab-45de-bd65-f0b3e41fba32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:56:49 user nova-compute[74820]: No targets found.
Nov 08 18:56:49 user nova-compute[74820]: iSNS:
Nov 08 18:56:49 user nova-compute[74820]: No targets found.
Nov 08 18:56:49 user nova-compute[74820]: STATIC:
Nov 08 18:56:49 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f
Nov 08 18:56:49 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:56:49 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:56:49 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:56:49 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:56:49 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:56:49 user nova-compute[74820]: FIRMWARE:
Nov 08 18:56:49 user nova-compute[74820]: No targets found.
Nov 08 18:56:49 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:56:49 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:56:49 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1193ed-1cdb-49b6-96b4-dbbef8fe2060]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac855b1f-dd11-4f77-b6ab-8cd6875ea019]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:56:49 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:56:49 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:56:49 user nova-compute[74820]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f (non-flash)
Nov 08 18:56:49 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e480b2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f4f87-17ea-4c52-b380-45114d5d9f22]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fa3c58-e4e9-45b3-90f1-ea5cb356c918]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de450c8-f6dd-483b-b43c-e1ee539fb20b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aea148-7bda-4bcc-80d9-3d02f5528bb3]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23537626439626263', '/dev/disk/by-id/scsi-1SCST_BIOdb04f3e4-57bd9bbcfb47b2bf', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_db04f3e4') {{(pid=86592) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a6c8af-2b60-4b7f-a0b6-f813bbaaf866]: (4, None) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updated VIF entry in instance network info cache for port e8360bd0-89e0-4f0e-9a18-01775def3efa. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [{"id": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "address": "fa:16:3e:2d:f2:66", "network": {"id": "f00078ff-e5dc-4bae-910a-c7f15cb71b80", "bridge": "br-int", "label": "tempest-TestShelveInstance-663476498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b5a8f5964e4c988c7e54a51dc8be27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8360bd0-89", "ovs_interfaceid": "e8360bd0-89e0-4f0e-9a18-01775def3efa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[61700ba8-1b38-4b67-8ee0-23c057e87bc0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9fbfbba3-641b-4786-a64b-6c38ea8f785b req-ec09b597-224d-4e84-b717-bbfab3aa871d service nova] Releasing lock "refresh_cache-8a9be69a-983b-43ec-a502-dae853095928" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9647ba42-0dfa-493e-bd4a-305f50b74ac9]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260]
Nov 08 18:56:50 user nova-compute[74820]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f, portal: 172.16.0.220,3260] successful.
Nov 08 18:56:50 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71d88bb3-f4f6-466e-83a2-c65e8c17c66f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc91f55-2975-46fb-937c-984a48b75dc3]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] <== disconnect_volume: return (320ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:56:50 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Deleting instance files /opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928_del
Nov 08 18:56:50 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Deletion of /opt/stack/data/nova/instances/8a9be69a-983b-43ec-a502-dae853095928_del complete
Nov 08 18:56:50 user nova-compute[74820]: INFO nova.compute.manager [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 08 18:56:50 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:50 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Took 0.49 seconds to deallocate network for instance.
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-2b0236dc-7254-43a3-90d2-967c9021dd6b req-48bb6d72-37f2-458e-b881-aa54839a0760 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-deleted-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:50 user nova-compute[74820]: INFO nova.compute.manager [req-2b0236dc-7254-43a3-90d2-967c9021dd6b req-48bb6d72-37f2-458e-b881-aa54839a0760 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Neutron deleted interface e8360bd0-89e0-4f0e-9a18-01775def3efa; detaching it from the instance and deleting it from the info cache
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.network.neutron [req-2b0236dc-7254-43a3-90d2-967c9021dd6b req-48bb6d72-37f2-458e-b881-aa54839a0760 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:56:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-2b0236dc-7254-43a3-90d2-967c9021dd6b req-48bb6d72-37f2-458e-b881-aa54839a0760 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Detach interface failed, port_id=e8360bd0-89e0-4f0e-9a18-01775def3efa, reason: Instance 8a9be69a-983b-43ec-a502-dae853095928 could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:56:51 user nova-compute[74820]: INFO nova.compute.manager [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Took 0.91 seconds to detach 1 volumes for instance.
Nov 08 18:56:51 user nova-compute[74820]: DEBUG nova.compute.manager [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Deleting volume: 71d88bb3-f4f6-466e-83a2-c65e8c17c66f {{(pid=74820) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e695da8-f30e-4232-b7a7-0276ac1f747f req-249d4c82-d549-43d0-ba05-ea82bb0d27c0 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e695da8-f30e-4232-b7a7-0276ac1f747f req-249d4c82-d549-43d0-ba05-ea82bb0d27c0 service nova] Acquiring lock "8a9be69a-983b-43ec-a502-dae853095928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e695da8-f30e-4232-b7a7-0276ac1f747f req-249d4c82-d549-43d0-ba05-ea82bb0d27c0 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e695da8-f30e-4232-b7a7-0276ac1f747f req-249d4c82-d549-43d0-ba05-ea82bb0d27c0 service nova] Lock "8a9be69a-983b-43ec-a502-dae853095928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e695da8-f30e-4232-b7a7-0276ac1f747f req-249d4c82-d549-43d0-ba05-ea82bb0d27c0 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] No waiting events found dispatching network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:56:51 user nova-compute[74820]: WARNING nova.compute.manager [req-6e695da8-f30e-4232-b7a7-0276ac1f747f req-249d4c82-d549-43d0-ba05-ea82bb0d27c0 service nova] [instance: 8a9be69a-983b-43ec-a502-dae853095928] Received unexpected event network-vif-plugged-e8360bd0-89e0-4f0e-9a18-01775def3efa for instance with vm_state active and task_state deleting.
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:51 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Deleted allocations for instance 8a9be69a-983b-43ec-a502-dae853095928
Nov 08 18:56:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-afa3a55f-2c9f-4e53-a063-a1ec8933ece1 tempest-TestShelveInstance-1981518489 tempest-TestShelveInstance-1981518489-project-member] Lock "8a9be69a-983b-43ec-a502-dae853095928" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.993s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:56:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:56:59 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 is timed out.
Nov 08 18:56:59 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully detached device vdb from instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 from the live domain config.
Nov 08 18:56:59 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyGkatQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:56:59 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e5958-6aac-42b2-a6e5-ff54bbf5c9f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 18:56:59 user nova-compute[74820]: No targets found.
Nov 08 18:56:59 user nova-compute[74820]: iSNS:
Nov 08 18:56:59 user nova-compute[74820]: No targets found.
Nov 08 18:56:59 user nova-compute[74820]: STATIC:
Nov 08 18:56:59 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a
Nov 08 18:56:59 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 18:56:59 user nova-compute[74820]:                 Iface Name: default
Nov 08 18:56:59 user nova-compute[74820]: FIRMWARE:
Nov 08 18:56:59 user nova-compute[74820]: No targets found.
Nov 08 18:56:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 18:56:59 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 18:56:59 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f72958-746d-48a0-97b7-a5d16bf26dd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a17b7-ba67-44db-97ff-bae6d1bfe598]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:56:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a (non-flash)
Nov 08 18:56:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e287e9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fbd16d-9dca-408a-8358-4b2227689da0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11da6e-cd2c-4100-9526-adcb75ddd13a]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c780e4a-1042-4389-8421-60af924b057e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66503407-b1cb-4336-a6b9-fe56d23605ec]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[18697b15-ec4c-4b1a-ad67-091103d08258]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b3ca12-2f20-4742-872c-db24ca9c8864]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260]
Nov 08 18:56:59 user nova-compute[74820]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a, portal: 172.16.0.220,3260] successful.
Nov 08 18:56:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:56:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc9a44b4-9841-461a-a61b-5aff3114689a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[363fafbb-091d-4217-943e-107a64ca3997]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:57:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 18:57:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 18:57:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== disconnect_volume: return (301ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:57:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 18:57:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'flavor' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:57:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-0d71bd2c-ea23-4062-bef5-bec338f1b752 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.009s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:57:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:10 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:57:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:57:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:57:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:57:11 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:57:12 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [{"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:57:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:57:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:57:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:13 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:57:13 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:57:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.097278594970703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 81728aff-572d-4015-b0a4-c299022d4ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:57:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:30 user nova-compute[74820]: INFO nova.compute.manager [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Terminating instance
Nov 08 18:57:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-79f8c6bf-f1bc-46f3-ab8d-ed3ba11af6a7 req-56cd1269-89f2-4ab5-a6ca-026905ff2e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-79f8c6bf-f1bc-46f3-ab8d-ed3ba11af6a7 req-56cd1269-89f2-4ab5-a6ca-026905ff2e97 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-79f8c6bf-f1bc-46f3-ab8d-ed3ba11af6a7 req-56cd1269-89f2-4ab5-a6ca-026905ff2e97 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-79f8c6bf-f1bc-46f3-ab8d-ed3ba11af6a7 req-56cd1269-89f2-4ab5-a6ca-026905ff2e97 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-79f8c6bf-f1bc-46f3-ab8d-ed3ba11af6a7 req-56cd1269-89f2-4ab5-a6ca-026905ff2e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:57:30 user nova-compute[74820]: DEBUG nova.compute.manager [req-79f8c6bf-f1bc-46f3-ab8d-ed3ba11af6a7 req-56cd1269-89f2-4ab5-a6ca-026905ff2e97 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-unplugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 18:57:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Instance destroyed successfully.
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lazy-loading 'resources' on Instance uuid 81728aff-572d-4015-b0a4-c299022d4ea1 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2136003210',display_name='tempest-ServerRescueNegativeTestJSON-server-2136003210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2136003210',id=26,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='622d25fd48684d82bb673a57cf0a7928',ramdisk_id='',reservation_id='r-iicek56j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1619361117',owner_user_name='tempest-ServerRescueNegativeTestJSON-1619361117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:45:22Z,user_data=None,user_id='cb2804c2bc374d52a2283e78f03959c6',uuid=81728aff-572d-4015-b0a4-c299022d4ea1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converting VIF {"id": "0096d7ac-f51d-46f5-add9-59141b6a0588", "address": "fa:16:3e:91:fc:b8", "network": {"id": "42b6f413-b7b9-4717-a293-561dacda1afd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-603601038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "622d25fd48684d82bb673a57cf0a7928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0096d7ac-f5", "ovs_interfaceid": "0096d7ac-f51d-46f5-add9-59141b6a0588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG os_vif [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0096d7ac-f5, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=987aaa37-40d2-43bf-a0e5-a755d418bc8d) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:31 user nova-compute[74820]: INFO os_vif [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:fc:b8,bridge_name='br-int',has_traffic_filtering=True,id=0096d7ac-f51d-46f5-add9-59141b6a0588,network=Network(42b6f413-b7b9-4717-a293-561dacda1afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0096d7ac-f5')
Nov 08 18:57:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Deleting instance files /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1_del
Nov 08 18:57:31 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Deletion of /opt/stack/data/nova/instances/81728aff-572d-4015-b0a4-c299022d4ea1_del complete
Nov 08 18:57:31 user nova-compute[74820]: INFO nova.compute.manager [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 08 18:57:31 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:57:31 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Took 0.63 seconds to deallocate network for instance.
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-522fb289-1380-4b9f-a5e7-3d790bcf04a8 req-e4012f04-0aab-4da9-b116-f1b8b7656512 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-deleted-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:57:31 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:57:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:32 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Deleted allocations for instance 81728aff-572d-4015-b0a4-c299022d4ea1
Nov 08 18:57:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-293fe44b-aa44-4157-9584-bd461420284c tempest-ServerRescueNegativeTestJSON-1619361117 tempest-ServerRescueNegativeTestJSON-1619361117-project-member] Lock "81728aff-572d-4015-b0a4-c299022d4ea1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.718s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-27db434b-6345-4776-a663-5a530159df85 req-3f533a89-b6a9-4ac4-a0ce-31b2960b7d13 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-27db434b-6345-4776-a663-5a530159df85 req-3f533a89-b6a9-4ac4-a0ce-31b2960b7d13 service nova] Acquiring lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-27db434b-6345-4776-a663-5a530159df85 req-3f533a89-b6a9-4ac4-a0ce-31b2960b7d13 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-27db434b-6345-4776-a663-5a530159df85 req-3f533a89-b6a9-4ac4-a0ce-31b2960b7d13 service nova] Lock "81728aff-572d-4015-b0a4-c299022d4ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:32 user nova-compute[74820]: DEBUG nova.compute.manager [req-27db434b-6345-4776-a663-5a530159df85 req-3f533a89-b6a9-4ac4-a0ce-31b2960b7d13 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] No waiting events found dispatching network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:57:32 user nova-compute[74820]: WARNING nova.compute.manager [req-27db434b-6345-4776-a663-5a530159df85 req-3f533a89-b6a9-4ac4-a0ce-31b2960b7d13 service nova] [instance: 81728aff-572d-4015-b0a4-c299022d4ea1] Received unexpected event network-vif-plugged-0096d7ac-f51d-46f5-add9-59141b6a0588 for instance with vm_state deleted and task_state None.
Nov 08 18:57:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:42 user nova-compute[74820]: INFO nova.compute.manager [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Terminating instance
Nov 08 18:57:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Instance destroyed successfully.
Nov 08 18:57:43 user nova-compute[74820]: DEBUG nova.objects.instance [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'resources' on Instance uuid a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1979140458',display_name='tempest-TestMinimumBasicScenario-server-1979140458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1979140458',id=44,image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMftBBI8Do7syVT0ExWaEfyhAaooQq0TQvwDDYzBqJirzEgdxmkWxu/xpkmMjc5KnpKv2/1O4sdaklmJfv0O4QCEQS6uKHKDyTjaDuGz9xM+grY0QKFmegoEO0pDz6qlvg==',key_name='tempest-TestMinimumBasicScenario-818040902',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-bpi90qfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b4d6cd59-84ac-476e-9b3e-669ed21595ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T18:54:53Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=a8dd70f3-5cb8-4500-aaad-e5b68c9c6775,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "address": "fa:16:3e:a4:74:5b", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fbafbc-92", "ovs_interfaceid": "71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG os_vif [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71fbafbc-92, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df692b0d-ec9c-4f56-bf78-2a229d37202c) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:57:43 user nova-compute[74820]: INFO os_vif [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:74:5b,bridge_name='br-int',has_traffic_filtering=True,id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fbafbc-92')
Nov 08 18:57:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Deleting instance files /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775_del
Nov 08 18:57:43 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Deletion of /opt/stack/data/nova/instances/a8dd70f3-5cb8-4500-aaad-e5b68c9c6775_del complete
Nov 08 18:57:43 user nova-compute[74820]: INFO nova.compute.manager [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 18:57:43 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 18:57:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-f1055504-ae9c-4240-bbc7-f311eea31703 req-27a4755e-8eb8-4001-8a67-fc876b071d14 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Received event network-vif-deleted-71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:44 user nova-compute[74820]: INFO nova.compute.manager [req-f1055504-ae9c-4240-bbc7-f311eea31703 req-27a4755e-8eb8-4001-8a67-fc876b071d14 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Neutron deleted interface 71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd; detaching it from the instance and deleting it from the info cache
Nov 08 18:57:44 user nova-compute[74820]: DEBUG nova.network.neutron [req-f1055504-ae9c-4240-bbc7-f311eea31703 req-27a4755e-8eb8-4001-8a67-fc876b071d14 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:57:44 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Took 0.46 seconds to deallocate network for instance.
Nov 08 18:57:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-f1055504-ae9c-4240-bbc7-f311eea31703 req-27a4755e-8eb8-4001-8a67-fc876b071d14 service nova] [instance: a8dd70f3-5cb8-4500-aaad-e5b68c9c6775] Detach interface failed, port_id=71fbafbc-92f7-4a66-bacb-09dd4dcfb0dd, reason: Instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775 could not be found. {{(pid=74820) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:57:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:44 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Deleted allocations for instance a8dd70f3-5cb8-4500-aaad-e5b68c9c6775
Nov 08 18:57:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-d2499151-ebf0-41e4-884d-c297d8a8b352 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "a8dd70f3-5cb8-4500-aaad-e5b68c9c6775" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:57:46 user nova-compute[74820]: INFO nova.compute.claims [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Claim successful on node user
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:46 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.policy [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5686817e320e4e0bb7fd71fae1a375c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a7b594e4b4ff3bb52470b1920e127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:57:46 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Creating image(s)
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.197s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk 1073741824" returned: 0 in 0.054s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Cannot resize image /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Ensure instance console log exists: /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Successfully created port: 3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:57:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Successfully updated port: 3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-changed-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.compute.manager [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Refreshing instance network info cache due to event network-changed-3891dc09-a81a-4a24-8355-fffc51ab7d53. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance network_info: |[{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Refreshing network info cache for port 3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start _get_guest_xml network_info=[{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:57:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:57:49 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.objects.instance [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'pci_devices' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:57:49 user nova-compute[74820]:   <uuid>d8b61294-3a44-449f-a144-08a0f0cf3555</uuid>
Nov 08 18:57:49 user nova-compute[74820]:   <name>instance-0000002f</name>
Nov 08 18:57:49 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:57:49 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:57:49 user nova-compute[74820]:   <metadata>
Nov 08 18:57:49 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:57:49 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:57:49 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeTestJSON-server-157022144</nova:name>
Nov 08 18:57:49 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:57:49</nova:creationTime>
Nov 08 18:57:49 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:57:49 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:57:49 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:57:49 user nova-compute[74820]:       <nova:owner>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:user uuid="5686817e320e4e0bb7fd71fae1a375c4">tempest-AttachVolumeTestJSON-247912662-project-member</nova:user>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:project uuid="5a9a7b594e4b4ff3bb52470b1920e127">tempest-AttachVolumeTestJSON-247912662</nova:project>
Nov 08 18:57:49 user nova-compute[74820]:       </nova:owner>
Nov 08 18:57:49 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 18:57:49 user nova-compute[74820]:       <nova:ports>
Nov 08 18:57:49 user nova-compute[74820]:         <nova:port uuid="3891dc09-a81a-4a24-8355-fffc51ab7d53">
Nov 08 18:57:49 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 18:57:49 user nova-compute[74820]:         </nova:port>
Nov 08 18:57:49 user nova-compute[74820]:       </nova:ports>
Nov 08 18:57:49 user nova-compute[74820]:     </nova:instance>
Nov 08 18:57:49 user nova-compute[74820]:   </metadata>
Nov 08 18:57:49 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:57:49 user nova-compute[74820]:     <system>
Nov 08 18:57:49 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:57:49 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:57:49 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:57:49 user nova-compute[74820]:       <entry name="serial">d8b61294-3a44-449f-a144-08a0f0cf3555</entry>
Nov 08 18:57:49 user nova-compute[74820]:       <entry name="uuid">d8b61294-3a44-449f-a144-08a0f0cf3555</entry>
Nov 08 18:57:49 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:57:49 user nova-compute[74820]:     </system>
Nov 08 18:57:49 user nova-compute[74820]:   </sysinfo>
Nov 08 18:57:49 user nova-compute[74820]:   <os>
Nov 08 18:57:49 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:57:49 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:57:49 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:57:49 user nova-compute[74820]:   </os>
Nov 08 18:57:49 user nova-compute[74820]:   <features>
Nov 08 18:57:49 user nova-compute[74820]:     <acpi/>
Nov 08 18:57:49 user nova-compute[74820]:     <apic/>
Nov 08 18:57:49 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:57:49 user nova-compute[74820]:   </features>
Nov 08 18:57:49 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:57:49 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:57:49 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:57:49 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:57:49 user nova-compute[74820]:   </clock>
Nov 08 18:57:49 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:57:49 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:57:49 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:57:49 user nova-compute[74820]:   </cpu>
Nov 08 18:57:49 user nova-compute[74820]:   <devices>
Nov 08 18:57:49 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:57:49 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:57:49 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk"/>
Nov 08 18:57:49 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:57:49 user nova-compute[74820]:     </disk>
Nov 08 18:57:49 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:57:49 user nova-compute[74820]:       <mac address="fa:16:3e:07:10:f3"/>
Nov 08 18:57:49 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:57:49 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:57:49 user nova-compute[74820]:       <target dev="tap3891dc09-a8"/>
Nov 08 18:57:49 user nova-compute[74820]:     </interface>
Nov 08 18:57:49 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:57:49 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/console.log" append="off"/>
Nov 08 18:57:49 user nova-compute[74820]:     </serial>
Nov 08 18:57:49 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:57:49 user nova-compute[74820]:     <video>
Nov 08 18:57:49 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:57:49 user nova-compute[74820]:     </video>
Nov 08 18:57:49 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:57:49 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:57:49 user nova-compute[74820]:     </rng>
Nov 08 18:57:49 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:57:49 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:57:49 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:57:49 user nova-compute[74820]:     </memballoon>
Nov 08 18:57:49 user nova-compute[74820]:   </devices>
Nov 08 18:57:49 user nova-compute[74820]: </domain>
Nov 08 18:57:49 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG os_vif [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5f161b2-9918-58a8-8b4f-4754c86ab1c8', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3891dc09-a8, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3891dc09-a8, col_values=(('qos', UUID('d7c43e18-7195-43f4-84e2-9abbb7694fa5')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3891dc09-a8, col_values=(('external_ids', {'iface-id': '3891dc09-a81a-4a24-8355-fffc51ab7d53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:10:f3', 'vm-uuid': 'd8b61294-3a44-449f-a144-08a0f0cf3555'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:49 user nova-compute[74820]: INFO os_vif [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8')
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No VIF found with MAC fa:16:3e:07:10:f3, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated VIF entry in instance network info cache for port 3891dc09-a81a-4a24-8355-fffc51ab7d53. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG nova.network.neutron [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:57:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ec57f13a-9e99-4f4d-84ca-3c84a85b69c3 req-0d634a44-9f9a-4cf2-b0d2-f105dc4ff4a4 service nova] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:57:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-21bd8c75-f697-4a55-b556-70508165a7d5 req-412b187b-9a01-4666-82c7-4be5bf1f65df service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-21bd8c75-f697-4a55-b556-70508165a7d5 req-412b187b-9a01-4666-82c7-4be5bf1f65df service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-21bd8c75-f697-4a55-b556-70508165a7d5 req-412b187b-9a01-4666-82c7-4be5bf1f65df service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-21bd8c75-f697-4a55-b556-70508165a7d5 req-412b187b-9a01-4666-82c7-4be5bf1f65df service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-21bd8c75-f697-4a55-b556-70508165a7d5 req-412b187b-9a01-4666-82c7-4be5bf1f65df service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:57:51 user nova-compute[74820]: WARNING nova.compute.manager [req-21bd8c75-f697-4a55-b556-70508165a7d5 req-412b187b-9a01-4666-82c7-4be5bf1f65df service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state building and task_state spawning.
Nov 08 18:57:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:57:53 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance spawned successfully.
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:57:53 user nova-compute[74820]: INFO nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-280b71a3-85b6-4983-a011-3cd936508fc6 req-3edf96af-cbf0-4eac-8ed3-db0c108fc62a service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-280b71a3-85b6-4983-a011-3cd936508fc6 req-3edf96af-cbf0-4eac-8ed3-db0c108fc62a service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-280b71a3-85b6-4983-a011-3cd936508fc6 req-3edf96af-cbf0-4eac-8ed3-db0c108fc62a service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-280b71a3-85b6-4983-a011-3cd936508fc6 req-3edf96af-cbf0-4eac-8ed3-db0c108fc62a service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-280b71a3-85b6-4983-a011-3cd936508fc6 req-3edf96af-cbf0-4eac-8ed3-db0c108fc62a service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:57:53 user nova-compute[74820]: WARNING nova.compute.manager [req-280b71a3-85b6-4983-a011-3cd936508fc6 req-3edf96af-cbf0-4eac-8ed3-db0c108fc62a service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state building and task_state spawning.
Nov 08 18:57:53 user nova-compute[74820]: INFO nova.compute.manager [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Took 6.92 seconds to build instance.
Nov 08 18:57:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-8453404d-e40c-4d1f-9ce6-5dbe49fdc359 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.010s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:57:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:57:59 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:57:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:58:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:58:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:58:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:58:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:58:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 18:58:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 18:58:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:14 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:58:15 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:58:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.115032196044922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:58:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:58:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 18:58:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:58:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:58:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:58:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:58:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:58:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 18:58:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:58:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 18:58:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 18:58:37 user nova-compute[74820]: INFO nova.compute.claims [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Claim successful on node user
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 18:58:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.policy [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '606ff562346743d89a203e59084fefcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef84eead1b49079ef0ca885650e61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 18:58:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Creating image(s)
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "/opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "/opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "/opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "b2795764e53216999a376b85bf208db751e0897d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "b2795764e53216999a376b85bf208db751e0897d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:38 user nova-compute[74820]: DEBUG nova.virt.images [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] 1f1fa900-94c3-4d08-bf89-3daa9bd1331b was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 18:58:38 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 18:58:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.part /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.network.neutron [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Successfully created port: 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.part /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.converted" returned: 0 in 0.667s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "b2795764e53216999a376b85bf208db751e0897d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.584s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "b2795764e53216999a376b85bf208db751e0897d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "b2795764e53216999a376b85bf208db751e0897d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d,backing_fmt=raw /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.network.neutron [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Successfully updated port: 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing instance network info cache due to event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.network.neutron [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d,backing_fmt=raw /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk 1073741824" returned: 0 in 0.070s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "b2795764e53216999a376b85bf208db751e0897d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.network.neutron [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.network.neutron [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5c2395fe-50c4-4485-b29b-59476a6ab20b req-22772d6e-4c60-4be8-9558-da3e24b6982f service nova] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:58:39 user nova-compute[74820]: DEBUG nova.network.neutron [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.network.neutron [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Cannot resize image /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Ensure instance console log exists: /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.network.neutron [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance network_info: |[{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Start _get_guest_xml network_info=[{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:58:34Z,direct_url=<?>,disk_format='qcow2',id=1f1fa900-94c3-4d08-bf89-3daa9bd1331b,min_disk=0,min_ram=0,name='tempest-scenario-img--587544688',owner='61ef84eead1b49079ef0ca885650e61e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '1f1fa900-94c3-4d08-bf89-3daa9bd1331b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 18:58:40 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:58:40 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:58:34Z,direct_url=<?>,disk_format='qcow2',id=1f1fa900-94c3-4d08-bf89-3daa9bd1331b,min_disk=0,min_ram=0,name='tempest-scenario-img--587544688',owner='61ef84eead1b49079ef0ca885650e61e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1819657057',display_name='tempest-TestMinimumBasicScenario-server-1819657057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1819657057',id=48,image_ref='1f1fa900-94c3-4d08-bf89-3daa9bd1331b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPox2qYZdR6f+2atGpX94n65mkHsBhCcYVF+mvHl/kin6PW1+uJwXqH0ikVIwvL1Ts0wkh95uJbX5vunDxL++LH6QrZpusVb8qQKhkujs5k/+XydJtnzHlqGc7UF+Rtfvg==',key_name='tempest-TestMinimumBasicScenario-1896608437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-179h73mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f1fa900-94c3-4d08-bf89-3daa9bd1331b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:58:38Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=99eb5ffc-b129-48c0-8248-cdd5a5db51ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'pci_devices' on Instance uuid 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] End _get_guest_xml xml=<domain type="kvm">
Nov 08 18:58:40 user nova-compute[74820]:   <uuid>99eb5ffc-b129-48c0-8248-cdd5a5db51ca</uuid>
Nov 08 18:58:40 user nova-compute[74820]:   <name>instance-00000030</name>
Nov 08 18:58:40 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 18:58:40 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 18:58:40 user nova-compute[74820]:   <metadata>
Nov 08 18:58:40 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 18:58:40 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 18:58:40 user nova-compute[74820]:       <nova:name>tempest-TestMinimumBasicScenario-server-1819657057</nova:name>
Nov 08 18:58:40 user nova-compute[74820]:       <nova:creationTime>2023-11-08 18:58:40</nova:creationTime>
Nov 08 18:58:40 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 18:58:40 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 18:58:40 user nova-compute[74820]:       </nova:flavor>
Nov 08 18:58:40 user nova-compute[74820]:       <nova:owner>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:user uuid="606ff562346743d89a203e59084fefcf">tempest-TestMinimumBasicScenario-1799886163-project-member</nova:user>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:project uuid="61ef84eead1b49079ef0ca885650e61e">tempest-TestMinimumBasicScenario-1799886163</nova:project>
Nov 08 18:58:40 user nova-compute[74820]:       </nova:owner>
Nov 08 18:58:40 user nova-compute[74820]:       <nova:root type="image" uuid="1f1fa900-94c3-4d08-bf89-3daa9bd1331b"/>
Nov 08 18:58:40 user nova-compute[74820]:       <nova:ports>
Nov 08 18:58:40 user nova-compute[74820]:         <nova:port uuid="47ff685e-fbd1-497d-ac09-c6e8c774413c">
Nov 08 18:58:40 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 18:58:40 user nova-compute[74820]:         </nova:port>
Nov 08 18:58:40 user nova-compute[74820]:       </nova:ports>
Nov 08 18:58:40 user nova-compute[74820]:     </nova:instance>
Nov 08 18:58:40 user nova-compute[74820]:   </metadata>
Nov 08 18:58:40 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 18:58:40 user nova-compute[74820]:     <system>
Nov 08 18:58:40 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 18:58:40 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 18:58:40 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 18:58:40 user nova-compute[74820]:       <entry name="serial">99eb5ffc-b129-48c0-8248-cdd5a5db51ca</entry>
Nov 08 18:58:40 user nova-compute[74820]:       <entry name="uuid">99eb5ffc-b129-48c0-8248-cdd5a5db51ca</entry>
Nov 08 18:58:40 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 18:58:40 user nova-compute[74820]:     </system>
Nov 08 18:58:40 user nova-compute[74820]:   </sysinfo>
Nov 08 18:58:40 user nova-compute[74820]:   <os>
Nov 08 18:58:40 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 18:58:40 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 18:58:40 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 18:58:40 user nova-compute[74820]:   </os>
Nov 08 18:58:40 user nova-compute[74820]:   <features>
Nov 08 18:58:40 user nova-compute[74820]:     <acpi/>
Nov 08 18:58:40 user nova-compute[74820]:     <apic/>
Nov 08 18:58:40 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 18:58:40 user nova-compute[74820]:   </features>
Nov 08 18:58:40 user nova-compute[74820]:   <clock offset="utc">
Nov 08 18:58:40 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 18:58:40 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 18:58:40 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 18:58:40 user nova-compute[74820]:   </clock>
Nov 08 18:58:40 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 18:58:40 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 18:58:40 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 18:58:40 user nova-compute[74820]:   </cpu>
Nov 08 18:58:40 user nova-compute[74820]:   <devices>
Nov 08 18:58:40 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 18:58:40 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 18:58:40 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk"/>
Nov 08 18:58:40 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 18:58:40 user nova-compute[74820]:     </disk>
Nov 08 18:58:40 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 18:58:40 user nova-compute[74820]:       <mac address="fa:16:3e:1a:f7:8d"/>
Nov 08 18:58:40 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:58:40 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 18:58:40 user nova-compute[74820]:       <target dev="tap47ff685e-fb"/>
Nov 08 18:58:40 user nova-compute[74820]:     </interface>
Nov 08 18:58:40 user nova-compute[74820]:     <serial type="pty">
Nov 08 18:58:40 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/console.log" append="off"/>
Nov 08 18:58:40 user nova-compute[74820]:     </serial>
Nov 08 18:58:40 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 18:58:40 user nova-compute[74820]:     <video>
Nov 08 18:58:40 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 18:58:40 user nova-compute[74820]:     </video>
Nov 08 18:58:40 user nova-compute[74820]:     <rng model="virtio">
Nov 08 18:58:40 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 18:58:40 user nova-compute[74820]:     </rng>
Nov 08 18:58:40 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 18:58:40 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 18:58:40 user nova-compute[74820]:       <stats period="10"/>
Nov 08 18:58:40 user nova-compute[74820]:     </memballoon>
Nov 08 18:58:40 user nova-compute[74820]:   </devices>
Nov 08 18:58:40 user nova-compute[74820]: </domain>
Nov 08 18:58:40 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1819657057',display_name='tempest-TestMinimumBasicScenario-server-1819657057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1819657057',id=48,image_ref='1f1fa900-94c3-4d08-bf89-3daa9bd1331b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPox2qYZdR6f+2atGpX94n65mkHsBhCcYVF+mvHl/kin6PW1+uJwXqH0ikVIwvL1Ts0wkh95uJbX5vunDxL++LH6QrZpusVb8qQKhkujs5k/+XydJtnzHlqGc7UF+Rtfvg==',key_name='tempest-TestMinimumBasicScenario-1896608437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-179h73mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f1fa900-94c3-4d08-bf89-3daa9bd1331b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T18:58:38Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=99eb5ffc-b129-48c0-8248-cdd5a5db51ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG os_vif [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ca3509c-c1f4-501e-bdfc-e83c1c6d7622', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47ff685e-fb, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47ff685e-fb, col_values=(('qos', UUID('485a5428-4d14-4ecd-a1e5-9a8d0cf09507')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47ff685e-fb, col_values=(('external_ids', {'iface-id': '47ff685e-fbd1-497d-ac09-c6e8c774413c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:f7:8d', 'vm-uuid': '99eb5ffc-b129-48c0-8248-cdd5a5db51ca'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:40 user nova-compute[74820]: INFO os_vif [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb')
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 18:58:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No VIF found with MAC fa:16:3e:1a:f7:8d, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 18:58:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-00b03130-1632-415a-a9d5-2ae424e9518d req-632ca301-5312-4e5a-8d28-ecd19e043715 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-00b03130-1632-415a-a9d5-2ae424e9518d req-632ca301-5312-4e5a-8d28-ecd19e043715 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-00b03130-1632-415a-a9d5-2ae424e9518d req-632ca301-5312-4e5a-8d28-ecd19e043715 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-00b03130-1632-415a-a9d5-2ae424e9518d req-632ca301-5312-4e5a-8d28-ecd19e043715 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-00b03130-1632-415a-a9d5-2ae424e9518d req-632ca301-5312-4e5a-8d28-ecd19e043715 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:58:42 user nova-compute[74820]: WARNING nova.compute.manager [req-00b03130-1632-415a-a9d5-2ae424e9518d req-632ca301-5312-4e5a-8d28-ecd19e043715 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state building and task_state spawning.
Nov 08 18:58:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-521b2338-ec69-4f32-b431-f0411ae234c8 req-f4304380-e773-43ea-834e-50d57a5cd250 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-521b2338-ec69-4f32-b431-f0411ae234c8 req-f4304380-e773-43ea-834e-50d57a5cd250 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-521b2338-ec69-4f32-b431-f0411ae234c8 req-f4304380-e773-43ea-834e-50d57a5cd250 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-521b2338-ec69-4f32-b431-f0411ae234c8 req-f4304380-e773-43ea-834e-50d57a5cd250 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-521b2338-ec69-4f32-b431-f0411ae234c8 req-f4304380-e773-43ea-834e-50d57a5cd250 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 18:58:44 user nova-compute[74820]: WARNING nova.compute.manager [req-521b2338-ec69-4f32-b431-f0411ae234c8 req-f4304380-e773-43ea-834e-50d57a5cd250 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state building and task_state spawning.
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 18:58:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance spawned successfully.
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 18:58:44 user nova-compute[74820]: INFO nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 08 18:58:44 user nova-compute[74820]: DEBUG nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 18:58:44 user nova-compute[74820]: INFO nova.compute.manager [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Took 7.17 seconds to build instance.
Nov 08 18:58:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-816d518b-2342-42a3-9ed8-ac831d27cd6e tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.270s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:58:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:58:58 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:58:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:11 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 18:59:13 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:59:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:59:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:59:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 18:59:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 18:59:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:59:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.052906036376953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 18:59:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:59:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:59:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:59:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 18:59:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-changed-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 18:59:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Refreshing instance network info cache due to event network-changed-3891dc09-a81a-4a24-8355-fffc51ab7d53. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 18:59:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 18:59:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 18:59:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Refreshing network info cache for port 3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 18:59:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated VIF entry in instance network info cache for port 3891dc09-a81a-4a24-8355-fffc51ab7d53. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 18:59:38 user nova-compute[74820]: DEBUG nova.network.neutron [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 18:59:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-828e7301-871e-457c-b838-ed2ab76eb8b9 req-e5f99c61-02cc-4289-954b-233bfe8f7efb service nova] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 18:59:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 18:59:45 user nova-compute[74820]: INFO nova.compute.manager [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Attaching volume 303fa2ea-77c8-45ac-9716-e98e472375ec to /dev/vdb
Nov 08 18:59:45 user nova-compute[74820]: DEBUG os_brick.utils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b95a1f8-3282-4529-92b6-e3878f97f3bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aec4b5e-3f60-413b-966c-d2138e0725f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc467b8-596e-4fba-8ada-d0f553cef539]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff72fd-3c31-4262-a6e2-0bdaa21cac12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 18:59:45 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 18:59:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491b714-ef08-4638-92d9-ea93edc31ece]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG os_brick.utils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 18:59:45 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating existing volume attachment record: 793f5038-cf3a-4b94-8106-8af224aa275e {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 18:59:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 18:59:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:07 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:08 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:12 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:00:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:00:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:00:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:00:14 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:00:15 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:00:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:00:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:00:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:00:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:17 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:00:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:19 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:00:19 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.042823791503906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:00:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:36 user nova-compute[74820]: DEBUG nova.objects.instance [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'flavor' on Instance uuid 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:37 user nova-compute[74820]: INFO nova.compute.manager [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Attaching volume 61788b89-586d-4389-b58f-265b7f6f74c0 to /dev/vdb
Nov 08 19:00:37 user nova-compute[74820]: DEBUG os_brick.utils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6a0bb7-081a-484f-b192-dc406f6481fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db563bc-9f70-4109-af87-010433c5ec5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[270e2614-84c5-4266-af3a-42aa49bb25d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[01469a1f-203b-4171-bbac-2764a3f5944e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:00:37 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:00:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3df6a-b48a-4c16-a062-8a2ee54aa814]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG os_brick.utils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:00:37 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating existing volume attachment record: 92110e8c-d84c-4411-9993-fad836f3a2ee {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:00:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:00:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:00:39 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5892d7d2-c105-462a-bffb-6eb83b6dd910]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:00:39 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8c71d-19ec-4afd-b7b0-2512c32bdfed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec] added
Nov 08 19:00:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[15123f0b-4449-4ad1-bd21-6fcb3504ec82]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b6ed8-9387-4a1d-9f87-818451d90776]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEotsVNL {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEotsVNL" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e54ed-3ad9-4d67-b013-fd6e38bd83a0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iEotsVNL'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e817b-3ce6-40f1-b9fa-59505b39e94d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac714f3-c3bc-46ce-a641-b88e679c0197]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:00:39 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:00:39 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:00:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:00:39 user nova-compute[74820]: 
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[901585e7-e682-44a4-a599-f0b86d3c0302]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]
Nov 08 19:00:39 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.
Nov 08 19:00:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb23fd2-fb7c-47a6-82b6-c94e0d79d9b7]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fff812d-5711-4b66-8f04-ff5da812b2e1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:00:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:00:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a2ac4-e636-4e3c-a7b8-e7c0d23e5c7c]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:00:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:00:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:00:40 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26231383438616231', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:00:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231383438616231', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:00:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:00:40 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:00:40 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:00:40 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:00:40 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:00:40 user nova-compute[74820]:   <serial>303fa2ea-77c8-45ac-9716-e98e472375ec</serial>
Nov 08 19:00:40 user nova-compute[74820]: </disk>
Nov 08 19:00:40 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No VIF found with MAC fa:16:3e:07:10:f3, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b97fed60-5cc3-43ca-b02d-ddaf2ace424f tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.763s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74820) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG nova.objects.instance [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-b0cd58c0-a241-4605-ace8-7dcb7df94d38 req-e991a68d-e0ec-4f97-aa31-34303b5c1982 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:00:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b0cd58c0-a241-4605-ace8-7dcb7df94d38 req-e991a68d-e0ec-4f97-aa31-34303b5c1982 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b0cd58c0-a241-4605-ace8-7dcb7df94d38 req-e991a68d-e0ec-4f97-aa31-34303b5c1982 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b0cd58c0-a241-4605-ace8-7dcb7df94d38 req-e991a68d-e0ec-4f97-aa31-34303b5c1982 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-b0cd58c0-a241-4605-ace8-7dcb7df94d38 req-e991a68d-e0ec-4f97-aa31-34303b5c1982 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:00:42 user nova-compute[74820]: WARNING nova.compute.manager [req-b0cd58c0-a241-4605-ace8-7dcb7df94d38 req-e991a68d-e0ec-4f97-aa31-34303b5c1982 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state active and task_state powering-off.
Nov 08 19:00:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance destroyed successfully.
Nov 08 19:00:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:00:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-91020a12-ad2c-44fc-8ab7-18bbdbb38319 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.971s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-5795012e-f6f7-441b-a628-9b0b3a703b6a req-5eaf4eb3-968f-42de-893d-bbdf2683ef06 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:00:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5795012e-f6f7-441b-a628-9b0b3a703b6a req-5eaf4eb3-968f-42de-893d-bbdf2683ef06 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:00:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5795012e-f6f7-441b-a628-9b0b3a703b6a req-5eaf4eb3-968f-42de-893d-bbdf2683ef06 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:00:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-5795012e-f6f7-441b-a628-9b0b3a703b6a req-5eaf4eb3-968f-42de-893d-bbdf2683ef06 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:00:44 user nova-compute[74820]: DEBUG nova.compute.manager [req-5795012e-f6f7-441b-a628-9b0b3a703b6a req-5eaf4eb3-968f-42de-893d-bbdf2683ef06 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:00:44 user nova-compute[74820]: WARNING nova.compute.manager [req-5795012e-f6f7-441b-a628-9b0b3a703b6a req-5eaf4eb3-968f-42de-893d-bbdf2683ef06 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state stopped and task_state None.
Nov 08 19:00:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:00:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:00:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:00:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:00:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:00:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFJZKgCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:01:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:01:00 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:01:00 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3803a941-c64c-4dcd-8135-f83fc402c790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:01:00 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d321c727-f81f-4bda-9fdb-db57507e4e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0] added
Nov 08 19:01:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceb1040-85b1-49a5-8d5a-c6ece137ba54]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f3c889-c204-4626-925a-ff788cf3f3db]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFJZKgCv {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFJZKgCv" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af22458-c6cc-4e40-bc4a-bd38b5a02a81]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFJZKgCv'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ced97-97a2-4a82-8885-865277117786]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6b9282-657e-4c17-ad4a-9be7dbac05e2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:01:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:01:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd44358-33ce-4b88-b129-1a12243595af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260]
Nov 08 19:01:00 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260] successful.
Nov 08 19:01:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c86fc1-59f7-41e7-a254-ee11b408fc44]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b0a928-2ed9-4606-8963-88ae51e25473]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:01:00 user nova-compute[74820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:01:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:01:00 user nova-compute[74820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:01:00 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6420a46-0ea8-4a3a-b5e0-38d7ca1a4fd3]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:01:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFJZKgCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:01:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:01:01 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26437396364326531', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:01:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437396364326531', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:01:01 user nova-compute[74820]: DEBUG nova.objects.instance [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'flavor' on Instance uuid 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:01:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:01:01 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:01:01 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 19:01:01 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:01:01 user nova-compute[74820]:   <serial>61788b89-586d-4389-b58f-265b7f6f74c0</serial>
Nov 08 19:01:01 user nova-compute[74820]: </disk>
Nov 08 19:01:01 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:01:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:01:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:01:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] No VIF found with MAC fa:16:3e:1a:f7:8d, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:01:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-216ccc11-c246-4765-9452-8c7cf1d05a06 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.143s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:01:04 user nova-compute[74820]: DEBUG nova.compute.manager [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing instance network info cache due to event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:01:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:01:04 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:01:04 user nova-compute[74820]: DEBUG nova.network.neutron [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:01:05 user nova-compute[74820]: DEBUG nova.network.neutron [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updated VIF entry in instance network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:01:05 user nova-compute[74820]: DEBUG nova.network.neutron [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:01:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-259ce53b-e5a1-443d-93eb-52ea9e64415d req-dc5479f0-92cd-4758-90f7-86565063b92f service nova] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:01:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:01:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing instance network info cache due to event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:01:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:01:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:01:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:08 user nova-compute[74820]: INFO nova.compute.manager [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Rebooting instance
Nov 08 19:01:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updated VIF entry in instance network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7cbc47ce-1aa3-4fcc-b685-ff4fb7faddd2 req-e70416c8-df6f-4a8c-b795-8f6088560eba service nova] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG nova.network.neutron [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:01:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-f2bdb280-7074-415b-8796-09f27adaab05 req-55b1af0f-5f26-4f3c-be55-5197beb623d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-unplugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f2bdb280-7074-415b-8796-09f27adaab05 req-55b1af0f-5f26-4f3c-be55-5197beb623d2 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f2bdb280-7074-415b-8796-09f27adaab05 req-55b1af0f-5f26-4f3c-be55-5197beb623d2 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f2bdb280-7074-415b-8796-09f27adaab05 req-55b1af0f-5f26-4f3c-be55-5197beb623d2 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:11 user nova-compute[74820]: DEBUG nova.compute.manager [req-f2bdb280-7074-415b-8796-09f27adaab05 req-55b1af0f-5f26-4f3c-be55-5197beb623d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-unplugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:01:11 user nova-compute[74820]: WARNING nova.compute.manager [req-f2bdb280-7074-415b-8796-09f27adaab05 req-55b1af0f-5f26-4f3c-be55-5197beb623d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-unplugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state active and task_state reboot_started.
Nov 08 19:01:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:12 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance shutdown successfully.
Nov 08 19:01:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-28d93a13-67ed-44d5-a747-fe6ca8d2333f req-3f89fbf5-262a-41da-9cb8-9dae308455d5 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-28d93a13-67ed-44d5-a747-fe6ca8d2333f req-3f89fbf5-262a-41da-9cb8-9dae308455d5 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-28d93a13-67ed-44d5-a747-fe6ca8d2333f req-3f89fbf5-262a-41da-9cb8-9dae308455d5 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-28d93a13-67ed-44d5-a747-fe6ca8d2333f req-3f89fbf5-262a-41da-9cb8-9dae308455d5 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-28d93a13-67ed-44d5-a747-fe6ca8d2333f req-3f89fbf5-262a-41da-9cb8-9dae308455d5 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:01:13 user nova-compute[74820]: WARNING nova.compute.manager [req-28d93a13-67ed-44d5-a747-fe6ca8d2333f req-3f89fbf5-262a-41da-9cb8-9dae308455d5 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state active and task_state reboot_started.
Nov 08 19:01:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:01:15 user nova-compute[74820]: WARNING nova.compute.manager [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state active and task_state reboot_started.
Nov 08 19:01:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG nova.compute.manager [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:01:15 user nova-compute[74820]: WARNING nova.compute.manager [req-6e3bcaec-7732-4c61-a32c-22eeb52cd9b4 req-ceaf6e3d-8f3c-40b3-9cc9-8ff37953a023 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state active and task_state reboot_started.
Nov 08 19:01:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance running successfully.
Nov 08 19:01:15 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance soft rebooted successfully.
Nov 08 19:01:15 user nova-compute[74820]: DEBUG nova.compute.manager [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2dee4965-06b5-4fdb-897e-bb01bbc200f9 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.419s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:01:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:01:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:01:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:01:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:01:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:01:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:19 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:01:20 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:01:21 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:01:21 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.038814544677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:01:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:01:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:01:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:01:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:02:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:02:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:02:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:02:16 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:02:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:02:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:02:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:02:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:02:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:02:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:02:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:02:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:02:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:02:21 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:02:23 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:02:23 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.03644561767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:02:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:02:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:02:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:02:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:02:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:32 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:02:33 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance destroyed successfully.
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'resources' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3891dc09-a8, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7c43e18-7195-43f4-84e2-9abbb7694fa5) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:33 user nova-compute[74820]: INFO os_vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8')
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:02:33 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a108f6-5a96-49f7-9ffc-0e40b8248720]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:02:33 user nova-compute[74820]: No targets found.
Nov 08 19:02:33 user nova-compute[74820]: iSNS:
Nov 08 19:02:33 user nova-compute[74820]: No targets found.
Nov 08 19:02:33 user nova-compute[74820]: STATIC:
Nov 08 19:02:33 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec
Nov 08 19:02:33 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:02:33 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:02:33 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0
Nov 08 19:02:33 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:02:33 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:02:33 user nova-compute[74820]: FIRMWARE:
Nov 08 19:02:33 user nova-compute[74820]: No targets found.
Nov 08 19:02:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:02:33 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:02:33 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[055194ee-fa05-442d-adfc-569d5ab0f402]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e9e5d1-a8ea-4f34-9e0e-949cfef5aeb1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:02:33 user nova-compute[74820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:02:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:02:33 user nova-compute[74820]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:02:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28269000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef97d72-1a2c-42a0-9fc9-20041fe525ca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499480f-b836-43a0-959a-dfe72479527f]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[447991b3-f898-4b72-863a-6993771e1367]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9382b9-522e-4202-8f88-694ac76cbdab]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5bc3de-38ca-4208-af19-9cc7f0365363]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2997ab-65b8-4382-8fe9-b0ebe75dbd6d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]
Nov 08 19:02:33 user nova-compute[74820]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.
Nov 08 19:02:33 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f90ee9c-f6a3-4a83-8eca-90ff4c647dfd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== disconnect_volume: return (347ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start _get_guest_xml network_info=[{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '793f5038-cf3a-4b94-8106-8af224aa275e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd8b61294-3a44-449f-a144-08a0f0cf3555', 'attached_at': '', 'detached_at': '', 'volume_id': '303fa2ea-77c8-45ac-9716-e98e472375ec', 'serial': '303fa2ea-77c8-45ac-9716-e98e472375ec'}, 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'numa_topology' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:33 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:02:33 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:02:33 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:02:33 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:02:33 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6526d1-7366-4ab1-b858-5633ecbcdc7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:02:33 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe38dc3-2bb3-4397-9c2c-257d8e8af37d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec] added
Nov 08 19:02:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[101109bb-d291-4832-81df-168e4c7d01dc]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a4cc3-7fd5-4a64-be71-56dd3ae4c738]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEotsVNL {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEotsVNL" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[769dffe9-33fe-4785-93b1-c59b2da492fd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iEotsVNL'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[796adc86-896b-4267-b4b2-d9bd60b3e296]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9547e-28e7-43ae-9996-7182881d1fd2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:02:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:02:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d084337-5c3f-41e6-89f4-df4c22f883fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]
Nov 08 19:02:34 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.
Nov 08 19:02:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e824d8-e5d8-4eb3-bbba-0acb7e0b71eb]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0783eb30-9fb2-4830-9e23-44d751e20741]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:02:34 user nova-compute[74820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:02:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:02:34 user nova-compute[74820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:02:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfec18e1-b086-4d8c-a675-d9fcec9553c0]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Verify base images {{(pid=74820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Image id 1f1fa900-94c3-4d08-bf89-3daa9bd1331b yields fingerprint b2795764e53216999a376b85bf208db751e0897d {{(pid=74820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 19:02:34 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] image 1f1fa900-94c3-4d08-bf89-3daa9bd1331b at (/opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d): checking
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] image 1f1fa900-94c3-4d08-bf89-3daa9bd1331b at (/opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d): image is in use {{(pid=74820) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Image id 71d031e1-e4c3-46c0-bfb5-c8044e0fbc93 yields fingerprint 28477c0901ec95487d4b808dd46694230e0454cf {{(pid=74820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 19:02:34 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] image 71d031e1-e4c3-46c0-bfb5-c8044e0fbc93 at (/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf): checking
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] image 71d031e1-e4c3-46c0-bfb5-c8044e0fbc93 at (/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf): image is in use {{(pid=74820) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] d8b61294-3a44-449f-a144-08a0f0cf3555 is a valid instance name {{(pid=74820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] d8b61294-3a44-449f-a144-08a0f0cf3555 has a disk file {{(pid=74820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 19:02:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 is backed by 28477c0901ec95487d4b808dd46694230e0454cf {{(pid=74820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] 99eb5ffc-b129-48c0-8248-cdd5a5db51ca is a valid instance name {{(pid=74820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] 99eb5ffc-b129-48c0-8248-cdd5a5db51ca has a disk file {{(pid=74820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26231383438616231', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231383438616231', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca is backed by b2795764e53216999a376b85bf208db751e0897d {{(pid=74820) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9
Nov 08 19:02:35 user nova-compute[74820]: WARNING nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Active base files: /opt/stack/data/nova/instances/_base/b2795764e53216999a376b85bf208db751e0897d /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Removable base files: /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0 /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1 /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249 /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9 /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79fbb50bf770edaa61bae56619a217a527a4bfe0
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/78389dc666de8d1c06083c438e2c530941996ffd
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3cd92e5ee9b320c6e1fdc89aefd895efc2669c1
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/58edf425191bc3848d997a755c0d2d7c09e0eeac
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2cc55fdd6b0e375af445a8ceeece04995f7b8249
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6e77f29b347b1cd7211c4bde5bcd8f44df62b4c9
Nov 08 19:02:35 user nova-compute[74820]: INFO nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6bddfd63647c3507152014b7e16ab6c8d1e5d0b7
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Verification complete {{(pid=74820) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Verify swap images {{(pid=74820) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.imagecache [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Verify ephemeral images {{(pid=74820) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'pci_devices' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] End _get_guest_xml xml=<domain type="kvm">
Nov 08 19:02:35 user nova-compute[74820]:   <uuid>d8b61294-3a44-449f-a144-08a0f0cf3555</uuid>
Nov 08 19:02:35 user nova-compute[74820]:   <name>instance-0000002f</name>
Nov 08 19:02:35 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 19:02:35 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 19:02:35 user nova-compute[74820]:   <metadata>
Nov 08 19:02:35 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 19:02:35 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 19:02:35 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeTestJSON-server-157022144</nova:name>
Nov 08 19:02:35 user nova-compute[74820]:       <nova:creationTime>2023-11-08 19:02:33</nova:creationTime>
Nov 08 19:02:35 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 19:02:35 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 19:02:35 user nova-compute[74820]:       </nova:flavor>
Nov 08 19:02:35 user nova-compute[74820]:       <nova:owner>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:user uuid="5686817e320e4e0bb7fd71fae1a375c4">tempest-AttachVolumeTestJSON-247912662-project-member</nova:user>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:project uuid="5a9a7b594e4b4ff3bb52470b1920e127">tempest-AttachVolumeTestJSON-247912662</nova:project>
Nov 08 19:02:35 user nova-compute[74820]:       </nova:owner>
Nov 08 19:02:35 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 19:02:35 user nova-compute[74820]:       <nova:ports>
Nov 08 19:02:35 user nova-compute[74820]:         <nova:port uuid="3891dc09-a81a-4a24-8355-fffc51ab7d53">
Nov 08 19:02:35 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 19:02:35 user nova-compute[74820]:         </nova:port>
Nov 08 19:02:35 user nova-compute[74820]:       </nova:ports>
Nov 08 19:02:35 user nova-compute[74820]:     </nova:instance>
Nov 08 19:02:35 user nova-compute[74820]:   </metadata>
Nov 08 19:02:35 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 19:02:35 user nova-compute[74820]:     <system>
Nov 08 19:02:35 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 19:02:35 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 19:02:35 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 19:02:35 user nova-compute[74820]:       <entry name="serial">d8b61294-3a44-449f-a144-08a0f0cf3555</entry>
Nov 08 19:02:35 user nova-compute[74820]:       <entry name="uuid">d8b61294-3a44-449f-a144-08a0f0cf3555</entry>
Nov 08 19:02:35 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 19:02:35 user nova-compute[74820]:     </system>
Nov 08 19:02:35 user nova-compute[74820]:   </sysinfo>
Nov 08 19:02:35 user nova-compute[74820]:   <os>
Nov 08 19:02:35 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 19:02:35 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 19:02:35 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 19:02:35 user nova-compute[74820]:   </os>
Nov 08 19:02:35 user nova-compute[74820]:   <features>
Nov 08 19:02:35 user nova-compute[74820]:     <acpi/>
Nov 08 19:02:35 user nova-compute[74820]:     <apic/>
Nov 08 19:02:35 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 19:02:35 user nova-compute[74820]:   </features>
Nov 08 19:02:35 user nova-compute[74820]:   <clock offset="utc">
Nov 08 19:02:35 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 19:02:35 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 19:02:35 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 19:02:35 user nova-compute[74820]:   </clock>
Nov 08 19:02:35 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 19:02:35 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 19:02:35 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 19:02:35 user nova-compute[74820]:   </cpu>
Nov 08 19:02:35 user nova-compute[74820]:   <devices>
Nov 08 19:02:35 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 19:02:35 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 19:02:35 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk"/>
Nov 08 19:02:35 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 19:02:35 user nova-compute[74820]:     </disk>
Nov 08 19:02:35 user nova-compute[74820]:     <disk type="block" device="disk">
Nov 08 19:02:35 user nova-compute[74820]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:02:35 user nova-compute[74820]:       <source dev="/dev/sdb"/>
Nov 08 19:02:35 user nova-compute[74820]:       <target dev="vdb" bus="virtio"/>
Nov 08 19:02:35 user nova-compute[74820]:       <serial>303fa2ea-77c8-45ac-9716-e98e472375ec</serial>
Nov 08 19:02:35 user nova-compute[74820]:     </disk>
Nov 08 19:02:35 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 19:02:35 user nova-compute[74820]:       <mac address="fa:16:3e:07:10:f3"/>
Nov 08 19:02:35 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:02:35 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 19:02:35 user nova-compute[74820]:       <target dev="tap3891dc09-a8"/>
Nov 08 19:02:35 user nova-compute[74820]:     </interface>
Nov 08 19:02:35 user nova-compute[74820]:     <serial type="pty">
Nov 08 19:02:35 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/console.log" append="off"/>
Nov 08 19:02:35 user nova-compute[74820]:     </serial>
Nov 08 19:02:35 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 19:02:35 user nova-compute[74820]:     <video>
Nov 08 19:02:35 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:02:35 user nova-compute[74820]:     </video>
Nov 08 19:02:35 user nova-compute[74820]:     <rng model="virtio">
Nov 08 19:02:35 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 19:02:35 user nova-compute[74820]:     </rng>
Nov 08 19:02:35 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 19:02:35 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 19:02:35 user nova-compute[74820]:       <stats period="10"/>
Nov 08 19:02:35 user nova-compute[74820]:     </memballoon>
Nov 08 19:02:35 user nova-compute[74820]:   </devices>
Nov 08 19:02:35 user nova-compute[74820]: </domain>
Nov 08 19:02:35 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 19:02:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Cannot resize image /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG nova.objects.instance [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'migration_context' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG nova.objects.base [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG os_vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5f161b2-9918-58a8-8b4f-4754c86ab1c8', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3891dc09-a8, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3891dc09-a8, col_values=(('qos', UUID('3e1324f0-2417-491c-a0c3-81e706f3ab1b')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3891dc09-a8, col_values=(('external_ids', {'iface-id': '3891dc09-a81a-4a24-8355-fffc51ab7d53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:10:f3', 'vm-uuid': 'd8b61294-3a44-449f-a144-08a0f0cf3555'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:36 user nova-compute[74820]: INFO os_vif [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8')
Nov 08 19:02:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-7d843f85-aef9-486b-88d5-a249d06a0ac1 req-a2e2ce1b-30c2-482d-ac49-18568a009793 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7d843f85-aef9-486b-88d5-a249d06a0ac1 req-a2e2ce1b-30c2-482d-ac49-18568a009793 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7d843f85-aef9-486b-88d5-a249d06a0ac1 req-a2e2ce1b-30c2-482d-ac49-18568a009793 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7d843f85-aef9-486b-88d5-a249d06a0ac1 req-a2e2ce1b-30c2-482d-ac49-18568a009793 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:02:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-7d843f85-aef9-486b-88d5-a249d06a0ac1 req-a2e2ce1b-30c2-482d-ac49-18568a009793 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:02:37 user nova-compute[74820]: WARNING nova.compute.manager [req-7d843f85-aef9-486b-88d5-a249d06a0ac1 req-a2e2ce1b-30c2-482d-ac49-18568a009793 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state stopped and task_state powering-on.
Nov 08 19:02:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 19:02:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance rebooted successfully.
Nov 08 19:02:39 user nova-compute[74820]: DEBUG nova.compute.manager [None req-704eb298-13bc-4df2-aafc-c4b731147420 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:02:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-6d49b4d9-019b-42f7-8e37-4045eb6a2116 req-02991247-cd95-4c24-bb90-b477e3750c40 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:02:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6d49b4d9-019b-42f7-8e37-4045eb6a2116 req-02991247-cd95-4c24-bb90-b477e3750c40 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:02:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6d49b4d9-019b-42f7-8e37-4045eb6a2116 req-02991247-cd95-4c24-bb90-b477e3750c40 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:02:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6d49b4d9-019b-42f7-8e37-4045eb6a2116 req-02991247-cd95-4c24-bb90-b477e3750c40 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:02:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-6d49b4d9-019b-42f7-8e37-4045eb6a2116 req-02991247-cd95-4c24-bb90-b477e3750c40 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:02:39 user nova-compute[74820]: WARNING nova.compute.manager [req-6d49b4d9-019b-42f7-8e37-4045eb6a2116 req-02991247-cd95-4c24-bb90-b477e3750c40 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state active and task_state None.
Nov 08 19:02:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:02:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:02:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing instance network info cache due to event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG nova.network.neutron [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG nova.network.neutron [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updated VIF entry in instance network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG nova.network.neutron [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:03:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-51c5f2ab-8e81-4c09-b484-5f1a96ca4165 req-5b75e799-1b57-4593-b808-2ceab797eb71 service nova] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing instance network info cache due to event network-changed-47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] Acquiring lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] Acquired lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Refreshing network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:03:01 user nova-compute[74820]: INFO nova.compute.manager [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Detaching volume 61788b89-586d-4389-b58f-265b7f6f74c0
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updated VIF entry in instance network info cache for port 47ff685e-fbd1-497d-ac09-c6e8c774413c. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.network.neutron [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [{"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:03:01 user nova-compute[74820]: INFO nova.virt.block_device [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Attempting to driver detach volume 61788b89-586d-4389-b58f-265b7f6f74c0 from mountpoint /dev/vdb
Nov 08 19:03:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-df61206c-9565-4192-869c-78db4c389b7a req-872be7bb-3473-4206-bc47-171e2d5702d2 service nova] Releasing lock "refresh_cache-99eb5ffc-b129-48c0-8248-cdd5a5db51ca" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Attempting to detach device vdb from instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:03:01 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:03:01 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 19:03:01 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:03:01 user nova-compute[74820]:   <serial>61788b89-586d-4389-b58f-265b7f6f74c0</serial>
Nov 08 19:03:01 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:03:01 user nova-compute[74820]: </disk>
Nov 08 19:03:01 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:03:01 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully detached device vdb from instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca from the persistent domain config.
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:03:01 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:03:01 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:03:01 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 19:03:01 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:03:01 user nova-compute[74820]:   <serial>61788b89-586d-4389-b58f-265b7f6f74c0</serial>
Nov 08 19:03:01 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:03:01 user nova-compute[74820]: </disk>
Nov 08 19:03:01 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:03:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:03:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:05 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:03:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:03:18 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:03:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:03:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:03:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:03:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:22 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca is timed out.
Nov 08 19:03:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully detached device vdb from instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca from the live domain config.
Nov 08 19:03:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFJZKgCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:03:22 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d72906-1efb-4b44-a92f-f13e6d7be922]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:03:22 user nova-compute[74820]: No targets found.
Nov 08 19:03:22 user nova-compute[74820]: iSNS:
Nov 08 19:03:22 user nova-compute[74820]: No targets found.
Nov 08 19:03:22 user nova-compute[74820]: STATIC:
Nov 08 19:03:22 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec
Nov 08 19:03:22 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:03:22 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:03:22 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0
Nov 08 19:03:22 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:03:22 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:03:22 user nova-compute[74820]: FIRMWARE:
Nov 08 19:03:22 user nova-compute[74820]: No targets found.
Nov 08 19:03:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:03:22 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:03:22 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[843521ad-d58f-4e2c-9717-c8e3d95b33bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f3b9ce-2f74-4cea-938e-52fbbcff1c4b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:03:22 user nova-compute[74820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:03:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 (non-flash)
Nov 08 19:03:22 user nova-compute[74820]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:03:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e281d9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3ff9a-83c9-4eba-86ff-ae12b2975054]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[17802202-34b4-497c-aae0-d02768d74553]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca543c15-b79d-4e2f-906b-8759fc58740d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec803582-2830-4bf5-805b-57db476edca0]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d0945-620f-4211-bbd3-82f76af3a38c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacdb9ed-74d1-4b14-a139-3dcbbdf582d0]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260]
Nov 08 19:03:22 user nova-compute[74820]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0, portal: 172.16.0.220,3260] successful.
Nov 08 19:03:22 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61788b89-586d-4389-b58f-265b7f6f74c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a7e3f3-76b0-428d-84d4-9fc58e0655e1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] <== disconnect_volume: return (273ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 19:03:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG nova.objects.instance [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'flavor' on Instance uuid 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-36f15620-6240-41db-8aff-7c4437adbfee tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:03:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:03:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:03:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:03:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=25.025279998779297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:03:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:03:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 19:03:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:03:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:03:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:03:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:03:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:03:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:03:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:03:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:03:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:03:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:03:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:03:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:03:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:03:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:03 user nova-compute[74820]: INFO nova.compute.manager [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Terminating instance
Nov 08 19:04:03 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-3344f525-883b-47ee-b614-d3e707816893 req-3be5fbf8-5688-4cb0-b9c7-5fc072feb353 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-unplugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3344f525-883b-47ee-b614-d3e707816893 req-3be5fbf8-5688-4cb0-b9c7-5fc072feb353 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3344f525-883b-47ee-b614-d3e707816893 req-3be5fbf8-5688-4cb0-b9c7-5fc072feb353 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-3344f525-883b-47ee-b614-d3e707816893 req-3be5fbf8-5688-4cb0-b9c7-5fc072feb353 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-3344f525-883b-47ee-b614-d3e707816893 req-3be5fbf8-5688-4cb0-b9c7-5fc072feb353 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-unplugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:04:03 user nova-compute[74820]: DEBUG nova.compute.manager [req-3344f525-883b-47ee-b614-d3e707816893 req-3be5fbf8-5688-4cb0-b9c7-5fc072feb353 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-unplugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 19:04:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Instance destroyed successfully.
Nov 08 19:04:04 user nova-compute[74820]: DEBUG nova.objects.instance [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lazy-loading 'resources' on Instance uuid 99eb5ffc-b129-48c0-8248-cdd5a5db51ca {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:58:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1819657057',display_name='tempest-TestMinimumBasicScenario-server-1819657057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1819657057',id=48,image_ref='1f1fa900-94c3-4d08-bf89-3daa9bd1331b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPox2qYZdR6f+2atGpX94n65mkHsBhCcYVF+mvHl/kin6PW1+uJwXqH0ikVIwvL1Ts0wkh95uJbX5vunDxL++LH6QrZpusVb8qQKhkujs5k/+XydJtnzHlqGc7UF+Rtfvg==',key_name='tempest-TestMinimumBasicScenario-1896608437',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61ef84eead1b49079ef0ca885650e61e',ramdisk_id='',reservation_id='r-179h73mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f1fa900-94c3-4d08-bf89-3daa9bd1331b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1799886163',owner_user_name='tempest-TestMinimumBasicScenario-1799886163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:01:16Z,user_data=None,user_id='606ff562346743d89a203e59084fefcf',uuid=99eb5ffc-b129-48c0-8248-cdd5a5db51ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converting VIF {"id": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "address": "fa:16:3e:1a:f7:8d", "network": {"id": "15ee3f6d-8b84-4274-ac42-938793459c68", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-313166049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61ef84eead1b49079ef0ca885650e61e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ff685e-fb", "ovs_interfaceid": "47ff685e-fbd1-497d-ac09-c6e8c774413c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG os_vif [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47ff685e-fb, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=485a5428-4d14-4ecd-a1e5-9a8d0cf09507) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:04 user nova-compute[74820]: INFO os_vif [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f7:8d,bridge_name='br-int',has_traffic_filtering=True,id=47ff685e-fbd1-497d-ac09-c6e8c774413c,network=Network(15ee3f6d-8b84-4274-ac42-938793459c68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ff685e-fb')
Nov 08 19:04:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Deleting instance files /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca_del
Nov 08 19:04:04 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Deletion of /opt/stack/data/nova/instances/99eb5ffc-b129-48c0-8248-cdd5a5db51ca_del complete
Nov 08 19:04:04 user nova-compute[74820]: INFO nova.compute.manager [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 19:04:04 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 19:04:04 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 19:04:05 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:04:05 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Took 0.47 seconds to deallocate network for instance.
Nov 08 19:04:05 user nova-compute[74820]: DEBUG nova.compute.manager [req-feec3462-c781-4203-b047-a5311e74a1cc req-50141715-34bb-4844-a3e5-d4afa085e868 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-deleted-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:04:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:05 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:04:05 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:04:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:05 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Deleted allocations for instance 99eb5ffc-b129-48c0-8248-cdd5a5db51ca
Nov 08 19:04:05 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39a3b72a-4569-4f61-ac74-f807a91c4048 tempest-TestMinimumBasicScenario-1799886163 tempest-TestMinimumBasicScenario-1799886163-project-member] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-545e3abe-8087-4a04-9104-cd6480886172 req-7e62a4c1-159c-4ee6-80f4-2cf80eed3ad1 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:04:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-545e3abe-8087-4a04-9104-cd6480886172 req-7e62a4c1-159c-4ee6-80f4-2cf80eed3ad1 service nova] Acquiring lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-545e3abe-8087-4a04-9104-cd6480886172 req-7e62a4c1-159c-4ee6-80f4-2cf80eed3ad1 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-545e3abe-8087-4a04-9104-cd6480886172 req-7e62a4c1-159c-4ee6-80f4-2cf80eed3ad1 service nova] Lock "99eb5ffc-b129-48c0-8248-cdd5a5db51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:06 user nova-compute[74820]: DEBUG nova.compute.manager [req-545e3abe-8087-4a04-9104-cd6480886172 req-7e62a4c1-159c-4ee6-80f4-2cf80eed3ad1 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] No waiting events found dispatching network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:04:06 user nova-compute[74820]: WARNING nova.compute.manager [req-545e3abe-8087-4a04-9104-cd6480886172 req-7e62a4c1-159c-4ee6-80f4-2cf80eed3ad1 service nova] [instance: 99eb5ffc-b129-48c0-8248-cdd5a5db51ca] Received unexpected event network-vif-plugged-47ff685e-fbd1-497d-ac09-c6e8c774413c for instance with vm_state deleted and task_state None.
Nov 08 19:04:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:11 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:14 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:04:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:04:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:24 user nova-compute[74820]: INFO nova.compute.manager [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Detaching volume 303fa2ea-77c8-45ac-9716-e98e472375ec
Nov 08 19:04:24 user nova-compute[74820]: INFO nova.virt.block_device [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Attempting to driver detach volume 303fa2ea-77c8-45ac-9716-e98e472375ec from mountpoint /dev/vdb
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Attempting to detach device vdb from instance d8b61294-3a44-449f-a144-08a0f0cf3555 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:04:24 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:04:24 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:04:24 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:04:24 user nova-compute[74820]:   <serial>303fa2ea-77c8-45ac-9716-e98e472375ec</serial>
Nov 08 19:04:24 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 19:04:24 user nova-compute[74820]: </disk>
Nov 08 19:04:24 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:04:24 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully detached device vdb from instance d8b61294-3a44-449f-a144-08a0f0cf3555 from the persistent domain config.
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8b61294-3a44-449f-a144-08a0f0cf3555 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:04:24 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:04:24 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:04:24 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:04:24 user nova-compute[74820]:   <serial>303fa2ea-77c8-45ac-9716-e98e472375ec</serial>
Nov 08 19:04:24 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 19:04:24 user nova-compute[74820]: </disk>
Nov 08 19:04:24 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:04:24 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:04:24 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=25.05152130126953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:04:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:04:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:04:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8b61294-3a44-449f-a144-08a0f0cf3555 is timed out.
Nov 08 19:04:44 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully detached device vdb from instance d8b61294-3a44-449f-a144-08a0f0cf3555 from the live domain config.
Nov 08 19:04:44 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEotsVNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:04:44 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c479dc1-351c-43bd-8e7a-9d9d10cc75ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:04:44 user nova-compute[74820]: No targets found.
Nov 08 19:04:44 user nova-compute[74820]: iSNS:
Nov 08 19:04:44 user nova-compute[74820]: No targets found.
Nov 08 19:04:44 user nova-compute[74820]: STATIC:
Nov 08 19:04:44 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec
Nov 08 19:04:44 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:04:44 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:04:44 user nova-compute[74820]: FIRMWARE:
Nov 08 19:04:44 user nova-compute[74820]: No targets found.
Nov 08 19:04:44 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:04:44 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:04:44 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4a845-818b-4bc1-8596-5ac9c2d9feeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f77b68-ac13-4b11-8383-cf7dffd07fe0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:04:44 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec (non-flash)
Nov 08 19:04:44 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e287e9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b54a6-06b2-4203-bc37-596c00c86793]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b81327-10fd-4b0e-b31f-07f56d61705e]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1045ac9-9c9c-47a3-9f40-014a7619d060]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a03682-b6c1-4861-8957-a4e85e20a275]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a687635-14bd-47bd-823e-a66493fcf6de]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:04:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[034e9b18-4298-4717-ac92-221f16cb3503]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260]
Nov 08 19:04:45 user nova-compute[74820]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec, portal: 172.16.0.220,3260] successful.
Nov 08 19:04:45 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303fa2ea-77c8-45ac-9716-e98e472375ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7bde61-c13f-4ab6-8376-bd41025a5358]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== disconnect_volume: return (293ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:04:45 user nova-compute[74820]: DEBUG nova.objects.instance [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15fb2b32-2729-4680-a17e-ec52d548cc73 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74820) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG nova.objects.instance [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-6783ed4b-94e9-456f-a514-9c291ba324f3 req-67eca32b-6a88-4e26-a3f9-bfbff7eccc60 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6783ed4b-94e9-456f-a514-9c291ba324f3 req-67eca32b-6a88-4e26-a3f9-bfbff7eccc60 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6783ed4b-94e9-456f-a514-9c291ba324f3 req-67eca32b-6a88-4e26-a3f9-bfbff7eccc60 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6783ed4b-94e9-456f-a514-9c291ba324f3 req-67eca32b-6a88-4e26-a3f9-bfbff7eccc60 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:46 user nova-compute[74820]: DEBUG nova.compute.manager [req-6783ed4b-94e9-456f-a514-9c291ba324f3 req-67eca32b-6a88-4e26-a3f9-bfbff7eccc60 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:04:46 user nova-compute[74820]: WARNING nova.compute.manager [req-6783ed4b-94e9-456f-a514-9c291ba324f3 req-67eca32b-6a88-4e26-a3f9-bfbff7eccc60 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state active and task_state powering-off.
Nov 08 19:04:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:47 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance destroyed successfully.
Nov 08 19:04:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:04:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-1c8d6245-c7d4-41f2-b9ed-1b48d7f4a264 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.841s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef9c18f2-8527-417d-9778-b81593ecbe2b req-2105e411-6134-4bee-ae01-dfa8d9ca3b7b service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:04:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef9c18f2-8527-417d-9778-b81593ecbe2b req-2105e411-6134-4bee-ae01-dfa8d9ca3b7b service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:04:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef9c18f2-8527-417d-9778-b81593ecbe2b req-2105e411-6134-4bee-ae01-dfa8d9ca3b7b service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:04:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef9c18f2-8527-417d-9778-b81593ecbe2b req-2105e411-6134-4bee-ae01-dfa8d9ca3b7b service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:04:48 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef9c18f2-8527-417d-9778-b81593ecbe2b req-2105e411-6134-4bee-ae01-dfa8d9ca3b7b service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:04:48 user nova-compute[74820]: WARNING nova.compute.manager [req-ef9c18f2-8527-417d-9778-b81593ecbe2b req-2105e411-6134-4bee-ae01-dfa8d9ca3b7b service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state stopped and task_state None.
Nov 08 19:04:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:04:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:04:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:09 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:16 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 19:05:17 user nova-compute[74820]: INFO nova.compute.claims [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Claim successful on node user
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 19:05:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.policy [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8b0241004ce41c5a1a6c84f4b3465ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df34dac541940fdaee1e9eb0416c3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 19:05:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Creating image(s)
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "/opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "/opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "/opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk 1073741824" returned: 0 in 0.051s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.195s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Successfully created port: 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Cannot resize image /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Ensure instance console log exists: /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Successfully updated port: 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-changed-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG nova.compute.manager [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Refreshing instance network info cache due to event network-changed-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:05:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.neutron [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Instance network_info: |[{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Refreshing network info cache for port 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Start _get_guest_xml network_info=[{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 19:05:19 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:05:19 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-873903775',display_name='tempest-TestStampPattern-server-873903775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-873903775',id=49,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Xz7HvuURkpQOW7B43HGiIZ6U9KG82L8l49gJ07K7KfnFUOaCugkIB6ZWljH9GuN9Bf7bDRJQjatX4jOFi1PJo04eQ40g/KkkxzLnHomEOqP8jhie2dM0OYzj4eed/uQ==',key_name='tempest-TestStampPattern-614517520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df34dac541940fdaee1e9eb0416c3f8',ramdisk_id='',reservation_id='r-pmn1s6qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-429227582',owner_user_name='tempest-TestStampPattern-429227582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:05:17Z,user_data=None,user_id='e8b0241004ce41c5a1a6c84f4b3465ac',uuid=445de213-a08f-40f8-82be-e6f8e7570cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converting VIF {"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'pci_devices' on Instance uuid 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] End _get_guest_xml xml=<domain type="kvm">
Nov 08 19:05:19 user nova-compute[74820]:   <uuid>445de213-a08f-40f8-82be-e6f8e7570cac</uuid>
Nov 08 19:05:19 user nova-compute[74820]:   <name>instance-00000031</name>
Nov 08 19:05:19 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 19:05:19 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 19:05:19 user nova-compute[74820]:   <metadata>
Nov 08 19:05:19 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 19:05:19 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 19:05:19 user nova-compute[74820]:       <nova:name>tempest-TestStampPattern-server-873903775</nova:name>
Nov 08 19:05:19 user nova-compute[74820]:       <nova:creationTime>2023-11-08 19:05:19</nova:creationTime>
Nov 08 19:05:19 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 19:05:19 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 19:05:19 user nova-compute[74820]:       </nova:flavor>
Nov 08 19:05:19 user nova-compute[74820]:       <nova:owner>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:user uuid="e8b0241004ce41c5a1a6c84f4b3465ac">tempest-TestStampPattern-429227582-project-member</nova:user>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:project uuid="8df34dac541940fdaee1e9eb0416c3f8">tempest-TestStampPattern-429227582</nova:project>
Nov 08 19:05:19 user nova-compute[74820]:       </nova:owner>
Nov 08 19:05:19 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 19:05:19 user nova-compute[74820]:       <nova:ports>
Nov 08 19:05:19 user nova-compute[74820]:         <nova:port uuid="4d3ede9d-2cda-46a2-80dd-caaa647ef5c9">
Nov 08 19:05:19 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 19:05:19 user nova-compute[74820]:         </nova:port>
Nov 08 19:05:19 user nova-compute[74820]:       </nova:ports>
Nov 08 19:05:19 user nova-compute[74820]:     </nova:instance>
Nov 08 19:05:19 user nova-compute[74820]:   </metadata>
Nov 08 19:05:19 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 19:05:19 user nova-compute[74820]:     <system>
Nov 08 19:05:19 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 19:05:19 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 19:05:19 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 19:05:19 user nova-compute[74820]:       <entry name="serial">445de213-a08f-40f8-82be-e6f8e7570cac</entry>
Nov 08 19:05:19 user nova-compute[74820]:       <entry name="uuid">445de213-a08f-40f8-82be-e6f8e7570cac</entry>
Nov 08 19:05:19 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 19:05:19 user nova-compute[74820]:     </system>
Nov 08 19:05:19 user nova-compute[74820]:   </sysinfo>
Nov 08 19:05:19 user nova-compute[74820]:   <os>
Nov 08 19:05:19 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 19:05:19 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 19:05:19 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 19:05:19 user nova-compute[74820]:   </os>
Nov 08 19:05:19 user nova-compute[74820]:   <features>
Nov 08 19:05:19 user nova-compute[74820]:     <acpi/>
Nov 08 19:05:19 user nova-compute[74820]:     <apic/>
Nov 08 19:05:19 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 19:05:19 user nova-compute[74820]:   </features>
Nov 08 19:05:19 user nova-compute[74820]:   <clock offset="utc">
Nov 08 19:05:19 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 19:05:19 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 19:05:19 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 19:05:19 user nova-compute[74820]:   </clock>
Nov 08 19:05:19 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 19:05:19 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 19:05:19 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 19:05:19 user nova-compute[74820]:   </cpu>
Nov 08 19:05:19 user nova-compute[74820]:   <devices>
Nov 08 19:05:19 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 19:05:19 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 19:05:19 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk"/>
Nov 08 19:05:19 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 19:05:19 user nova-compute[74820]:     </disk>
Nov 08 19:05:19 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 19:05:19 user nova-compute[74820]:       <mac address="fa:16:3e:78:1a:b5"/>
Nov 08 19:05:19 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:05:19 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 19:05:19 user nova-compute[74820]:       <target dev="tap4d3ede9d-2c"/>
Nov 08 19:05:19 user nova-compute[74820]:     </interface>
Nov 08 19:05:19 user nova-compute[74820]:     <serial type="pty">
Nov 08 19:05:19 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/console.log" append="off"/>
Nov 08 19:05:19 user nova-compute[74820]:     </serial>
Nov 08 19:05:19 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 19:05:19 user nova-compute[74820]:     <video>
Nov 08 19:05:19 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:05:19 user nova-compute[74820]:     </video>
Nov 08 19:05:19 user nova-compute[74820]:     <rng model="virtio">
Nov 08 19:05:19 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 19:05:19 user nova-compute[74820]:     </rng>
Nov 08 19:05:19 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 19:05:19 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 19:05:19 user nova-compute[74820]:       <stats period="10"/>
Nov 08 19:05:19 user nova-compute[74820]:     </memballoon>
Nov 08 19:05:19 user nova-compute[74820]:   </devices>
Nov 08 19:05:19 user nova-compute[74820]: </domain>
Nov 08 19:05:19 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-873903775',display_name='tempest-TestStampPattern-server-873903775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-873903775',id=49,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Xz7HvuURkpQOW7B43HGiIZ6U9KG82L8l49gJ07K7KfnFUOaCugkIB6ZWljH9GuN9Bf7bDRJQjatX4jOFi1PJo04eQ40g/KkkxzLnHomEOqP8jhie2dM0OYzj4eed/uQ==',key_name='tempest-TestStampPattern-614517520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df34dac541940fdaee1e9eb0416c3f8',ramdisk_id='',reservation_id='r-pmn1s6qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-429227582',owner_user_name='tempest-TestStampPattern-429227582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:05:17Z,user_data=None,user_id='e8b0241004ce41c5a1a6c84f4b3465ac',uuid=445de213-a08f-40f8-82be-e6f8e7570cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converting VIF {"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG os_vif [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8272c15-d1df-5381-b8cf-7a4d0b963bec', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d3ede9d-2c, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d3ede9d-2c, col_values=(('qos', UUID('161fb763-45e6-4e29-a742-5a6bacf05a53')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d3ede9d-2c, col_values=(('external_ids', {'iface-id': '4d3ede9d-2cda-46a2-80dd-caaa647ef5c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:1a:b5', 'vm-uuid': '445de213-a08f-40f8-82be-e6f8e7570cac'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:19 user nova-compute[74820]: INFO os_vif [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c')
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No VIF found with MAC fa:16:3e:78:1a:b5, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updated VIF entry in instance network info cache for port 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG nova.network.neutron [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-357d14f6-acb7-4a9c-82f0-270b080b9c0a req-6ea77011-74ac-4511-9913-20a58ca02c91 service nova] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Skipping network cache update for instance because it is Building. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:05:20 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-58e32bbd-6804-4e70-8d10-aef91d594bdb req-fc7967a8-601a-49cc-a630-55f8d33e2407 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-58e32bbd-6804-4e70-8d10-aef91d594bdb req-fc7967a8-601a-49cc-a630-55f8d33e2407 service nova] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-58e32bbd-6804-4e70-8d10-aef91d594bdb req-fc7967a8-601a-49cc-a630-55f8d33e2407 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-58e32bbd-6804-4e70-8d10-aef91d594bdb req-fc7967a8-601a-49cc-a630-55f8d33e2407 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG nova.compute.manager [req-58e32bbd-6804-4e70-8d10-aef91d594bdb req-fc7967a8-601a-49cc-a630-55f8d33e2407 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] No waiting events found dispatching network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:05:21 user nova-compute[74820]: WARNING nova.compute.manager [req-58e32bbd-6804-4e70-8d10-aef91d594bdb req-fc7967a8-601a-49cc-a630-55f8d33e2407 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received unexpected event network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 for instance with vm_state building and task_state spawning.
Nov 08 19:05:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 19:05:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 19:05:22 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Instance spawned successfully.
Nov 08 19:05:22 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-480a041a-562e-4e0e-9e1b-612b90485a2e req-2a5bc339-24b1-40fb-80d2-2e966c1beb55 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-480a041a-562e-4e0e-9e1b-612b90485a2e req-2a5bc339-24b1-40fb-80d2-2e966c1beb55 service nova] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-480a041a-562e-4e0e-9e1b-612b90485a2e req-2a5bc339-24b1-40fb-80d2-2e966c1beb55 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-480a041a-562e-4e0e-9e1b-612b90485a2e req-2a5bc339-24b1-40fb-80d2-2e966c1beb55 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.compute.manager [req-480a041a-562e-4e0e-9e1b-612b90485a2e req-2a5bc339-24b1-40fb-80d2-2e966c1beb55 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] No waiting events found dispatching network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:05:23 user nova-compute[74820]: WARNING nova.compute.manager [req-480a041a-562e-4e0e-9e1b-612b90485a2e req-2a5bc339-24b1-40fb-80d2-2e966c1beb55 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received unexpected event network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 for instance with vm_state building and task_state spawning.
Nov 08 19:05:23 user nova-compute[74820]: INFO nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:05:23 user nova-compute[74820]: INFO nova.compute.manager [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Took 6.07 seconds to build instance.
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b45ba345-5cde-4170-8f30-23292355c848 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.168s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:05:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:05:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:05:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:05:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=25.087677001953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:05:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:05:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:05:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:05:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:05:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:05:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:05:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:06:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:06:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:13 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:14 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:06:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:06:21 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:22 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:06:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:06:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:06:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:06:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:06:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:06:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:06:23 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:06:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:06:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.059310913085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:06:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:06:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:06:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:06:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance destroyed successfully.
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'resources' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG os_vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3891dc09-a8, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e1324f0-2417-491c-a0c3-81e706f3ab1b) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:38 user nova-compute[74820]: INFO os_vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8')
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start _get_guest_xml network_info=[{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'numa_topology' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:06:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'pci_devices' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] End _get_guest_xml xml=<domain type="kvm">
Nov 08 19:06:38 user nova-compute[74820]:   <uuid>d8b61294-3a44-449f-a144-08a0f0cf3555</uuid>
Nov 08 19:06:38 user nova-compute[74820]:   <name>instance-0000002f</name>
Nov 08 19:06:38 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 19:06:38 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 19:06:38 user nova-compute[74820]:   <metadata>
Nov 08 19:06:38 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 19:06:38 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 19:06:38 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeTestJSON-server-157022144</nova:name>
Nov 08 19:06:38 user nova-compute[74820]:       <nova:creationTime>2023-11-08 19:06:38</nova:creationTime>
Nov 08 19:06:38 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 19:06:38 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 19:06:38 user nova-compute[74820]:       </nova:flavor>
Nov 08 19:06:38 user nova-compute[74820]:       <nova:owner>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:user uuid="5686817e320e4e0bb7fd71fae1a375c4">tempest-AttachVolumeTestJSON-247912662-project-member</nova:user>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:project uuid="5a9a7b594e4b4ff3bb52470b1920e127">tempest-AttachVolumeTestJSON-247912662</nova:project>
Nov 08 19:06:38 user nova-compute[74820]:       </nova:owner>
Nov 08 19:06:38 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 19:06:38 user nova-compute[74820]:       <nova:ports>
Nov 08 19:06:38 user nova-compute[74820]:         <nova:port uuid="3891dc09-a81a-4a24-8355-fffc51ab7d53">
Nov 08 19:06:38 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 19:06:38 user nova-compute[74820]:         </nova:port>
Nov 08 19:06:38 user nova-compute[74820]:       </nova:ports>
Nov 08 19:06:38 user nova-compute[74820]:     </nova:instance>
Nov 08 19:06:38 user nova-compute[74820]:   </metadata>
Nov 08 19:06:38 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 19:06:38 user nova-compute[74820]:     <system>
Nov 08 19:06:38 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 19:06:38 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 19:06:38 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 19:06:38 user nova-compute[74820]:       <entry name="serial">d8b61294-3a44-449f-a144-08a0f0cf3555</entry>
Nov 08 19:06:38 user nova-compute[74820]:       <entry name="uuid">d8b61294-3a44-449f-a144-08a0f0cf3555</entry>
Nov 08 19:06:38 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 19:06:38 user nova-compute[74820]:     </system>
Nov 08 19:06:38 user nova-compute[74820]:   </sysinfo>
Nov 08 19:06:38 user nova-compute[74820]:   <os>
Nov 08 19:06:38 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 19:06:38 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 19:06:38 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 19:06:38 user nova-compute[74820]:   </os>
Nov 08 19:06:38 user nova-compute[74820]:   <features>
Nov 08 19:06:38 user nova-compute[74820]:     <acpi/>
Nov 08 19:06:38 user nova-compute[74820]:     <apic/>
Nov 08 19:06:38 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 19:06:38 user nova-compute[74820]:   </features>
Nov 08 19:06:38 user nova-compute[74820]:   <clock offset="utc">
Nov 08 19:06:38 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 19:06:38 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 19:06:38 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 19:06:38 user nova-compute[74820]:   </clock>
Nov 08 19:06:38 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 19:06:38 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 19:06:38 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 19:06:38 user nova-compute[74820]:   </cpu>
Nov 08 19:06:38 user nova-compute[74820]:   <devices>
Nov 08 19:06:38 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 19:06:38 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 19:06:38 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk"/>
Nov 08 19:06:38 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 19:06:38 user nova-compute[74820]:     </disk>
Nov 08 19:06:38 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 19:06:38 user nova-compute[74820]:       <mac address="fa:16:3e:07:10:f3"/>
Nov 08 19:06:38 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:06:38 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 19:06:38 user nova-compute[74820]:       <target dev="tap3891dc09-a8"/>
Nov 08 19:06:38 user nova-compute[74820]:     </interface>
Nov 08 19:06:38 user nova-compute[74820]:     <serial type="pty">
Nov 08 19:06:38 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/console.log" append="off"/>
Nov 08 19:06:38 user nova-compute[74820]:     </serial>
Nov 08 19:06:38 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 19:06:38 user nova-compute[74820]:     <video>
Nov 08 19:06:38 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:06:38 user nova-compute[74820]:     </video>
Nov 08 19:06:38 user nova-compute[74820]:     <rng model="virtio">
Nov 08 19:06:38 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 19:06:38 user nova-compute[74820]:     </rng>
Nov 08 19:06:38 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 19:06:38 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 19:06:38 user nova-compute[74820]:       <stats period="10"/>
Nov 08 19:06:38 user nova-compute[74820]:     </memballoon>
Nov 08 19:06:38 user nova-compute[74820]:   </devices>
Nov 08 19:06:38 user nova-compute[74820]: </domain>
Nov 08 19:06:38 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Cannot resize image /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'migration_context' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.objects.base [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Object Instance<d8b61294-3a44-449f-a144-08a0f0cf3555> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74820) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG os_vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5f161b2-9918-58a8-8b4f-4754c86ab1c8', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3891dc09-a8, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3891dc09-a8, col_values=(('qos', UUID('729b9c30-df9c-4cbd-addd-c1cb87863b04')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3891dc09-a8, col_values=(('external_ids', {'iface-id': '3891dc09-a81a-4a24-8355-fffc51ab7d53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:10:f3', 'vm-uuid': 'd8b61294-3a44-449f-a144-08a0f0cf3555'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:38 user nova-compute[74820]: INFO os_vif [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8')
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-0d58141e-602a-4142-bc2b-5f3913f77b1b req-6caa1176-dc8c-4027-ac20-cf1579331ab6 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0d58141e-602a-4142-bc2b-5f3913f77b1b req-6caa1176-dc8c-4027-ac20-cf1579331ab6 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0d58141e-602a-4142-bc2b-5f3913f77b1b req-6caa1176-dc8c-4027-ac20-cf1579331ab6 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-0d58141e-602a-4142-bc2b-5f3913f77b1b req-6caa1176-dc8c-4027-ac20-cf1579331ab6 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG nova.compute.manager [req-0d58141e-602a-4142-bc2b-5f3913f77b1b req-6caa1176-dc8c-4027-ac20-cf1579331ab6 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:06:40 user nova-compute[74820]: WARNING nova.compute.manager [req-0d58141e-602a-4142-bc2b-5f3913f77b1b req-6caa1176-dc8c-4027-ac20-cf1579331ab6 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state stopped and task_state powering-on.
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 19:06:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance rebooted successfully.
Nov 08 19:06:42 user nova-compute[74820]: DEBUG nova.compute.manager [None req-9b042112-ee67-4c2e-8414-1d39aa2ea5d4 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:06:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-7bb7c463-a665-4d1f-b651-4c8e33a144a5 req-29cddbf8-525e-4713-932a-e3a20770342f service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:06:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7bb7c463-a665-4d1f-b651-4c8e33a144a5 req-29cddbf8-525e-4713-932a-e3a20770342f service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:06:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7bb7c463-a665-4d1f-b651-4c8e33a144a5 req-29cddbf8-525e-4713-932a-e3a20770342f service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:06:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7bb7c463-a665-4d1f-b651-4c8e33a144a5 req-29cddbf8-525e-4713-932a-e3a20770342f service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:06:42 user nova-compute[74820]: DEBUG nova.compute.manager [req-7bb7c463-a665-4d1f-b651-4c8e33a144a5 req-29cddbf8-525e-4713-932a-e3a20770342f service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:06:42 user nova-compute[74820]: WARNING nova.compute.manager [req-7bb7c463-a665-4d1f-b651-4c8e33a144a5 req-29cddbf8-525e-4713-932a-e3a20770342f service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state active and task_state None.
Nov 08 19:06:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:06:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:06:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:06:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:06:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-changed-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG nova.compute.manager [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Refreshing instance network info cache due to event network-changed-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG nova.network.neutron [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Refreshing network info cache for port 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG nova.objects.instance [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'flavor' on Instance uuid 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:07:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:07:09 user nova-compute[74820]: INFO nova.compute.manager [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Attaching volume b71ce4cb-63c1-4a02-8e19-1345997f5048 to /dev/vdb
Nov 08 19:07:09 user nova-compute[74820]: DEBUG os_brick.utils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab020d-2fc1-4203-89b7-2c367b7eca2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e596883-6636-4d06-9c66-16a28cee94ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a047012-1c16-4943-b9bc-adc1d69a5821]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f24373e-20d8-45a1-a14a-818a410e635b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:07:09 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c957e7a-29c3-4770-a926-b3025bb8b58d]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG os_brick.utils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating existing volume attachment record: 843f680b-e826-4ae9-a29e-77b6050e5ef2 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updated VIF entry in instance network info cache for port 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG nova.network.neutron [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:07:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7f02ecfe-d3ad-4fad-a09b-906f114541d0 req-a0182782-658b-4cc6-922f-8eff36ce6cc7 service nova] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:07:10 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:17 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:07:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:07:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:07:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:07:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:07:25 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.057601928710938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:07:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:07:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gRBvnQaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:07:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:07:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:07:30 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d5db0-0e2a-4917-b353-db51daafb816]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:07:30 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9feb3e4-78db-45db-a250-8ac71f4b7e71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048] added
Nov 08 19:07:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba74fb-7672-41ee-ba32-3d691704380b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[006cc15a-ae85-4093-bf9b-b1fe8645e4a1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gRBvnQaL {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gRBvnQaL" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb618f-c8c6-4b4e-b73e-3c0c6d48af08]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gRBvnQaL'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f89812-0b05-4651-8201-7a7d95931d36]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efeb38-a67f-4137-90df-c0b2757b6a04]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:07:30 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:07:30 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:07:30 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:07:30 user nova-compute[74820]: 
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a312f6-4b2a-4154-9b90-60bf165f9f6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260]
Nov 08 19:07:30 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260] successful.
Nov 08 19:07:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec427a-58b3-45a0-a981-dbc1aaf7c90b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d58ff72-ea16-4514-8322-066a9f8472ef]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 (non-flash)
Nov 08 19:07:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 (non-flash)
Nov 08 19:07:30 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae5647f-eea1-4588-bf86-d822e815df52]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:30 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gRBvnQaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23833636666633963', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833636666633963', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'flavor' on Instance uuid 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:07:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:07:31 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:07:31 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:07:31 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:07:31 user nova-compute[74820]:   <serial>b71ce4cb-63c1-4a02-8e19-1345997f5048</serial>
Nov 08 19:07:31 user nova-compute[74820]: </disk>
Nov 08 19:07:31 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:07:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:07:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:07:32 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No VIF found with MAC fa:16:3e:78:1a:b5, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:07:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-359304c7-4af2-453b-8ee8-68ae42a296c1 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.460s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:07:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:07:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:07:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:07:35 user nova-compute[74820]: INFO nova.compute.manager [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Detaching volume b71ce4cb-63c1-4a02-8e19-1345997f5048
Nov 08 19:07:35 user nova-compute[74820]: INFO nova.virt.block_device [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Attempting to driver detach volume b71ce4cb-63c1-4a02-8e19-1345997f5048 from mountpoint /dev/vdb
Nov 08 19:07:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Attempting to detach device vdb from instance 445de213-a08f-40f8-82be-e6f8e7570cac from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:07:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:07:35 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:07:35 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:07:35 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:07:35 user nova-compute[74820]:   <serial>b71ce4cb-63c1-4a02-8e19-1345997f5048</serial>
Nov 08 19:07:35 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:07:35 user nova-compute[74820]: </disk>
Nov 08 19:07:35 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:07:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully detached device vdb from instance 445de213-a08f-40f8-82be-e6f8e7570cac from the persistent domain config.
Nov 08 19:07:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 445de213-a08f-40f8-82be-e6f8e7570cac from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:07:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:07:35 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:07:35 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:07:35 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:07:35 user nova-compute[74820]:   <serial>b71ce4cb-63c1-4a02-8e19-1345997f5048</serial>
Nov 08 19:07:35 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:07:35 user nova-compute[74820]: </disk>
Nov 08 19:07:35 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:07:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:07:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:07:56 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 445de213-a08f-40f8-82be-e6f8e7570cac is timed out.
Nov 08 19:07:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully detached device vdb from instance 445de213-a08f-40f8-82be-e6f8e7570cac from the live domain config.
Nov 08 19:07:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gRBvnQaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:07:56 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a452c6-a31d-4f62-99e9-2be6e62ff639]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:07:56 user nova-compute[74820]: No targets found.
Nov 08 19:07:56 user nova-compute[74820]: iSNS:
Nov 08 19:07:56 user nova-compute[74820]: No targets found.
Nov 08 19:07:56 user nova-compute[74820]: STATIC:
Nov 08 19:07:56 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048
Nov 08 19:07:56 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:07:56 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:07:56 user nova-compute[74820]: FIRMWARE:
Nov 08 19:07:56 user nova-compute[74820]: No targets found.
Nov 08 19:07:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:07:56 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:07:56 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e5e6f4-d1b6-4610-b77a-0a2ff5d21474]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[486edf54-5dc4-4e16-807d-5bda873994b1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 (non-flash)
Nov 08 19:07:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 (non-flash)
Nov 08 19:07:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e281daef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e320d14-1e4d-45b1-9836-33d11f7c3603]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ed2928-3993-47f9-9934-b732e9a0aafa]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[22952d46-708f-4a8d-b4ad-32282f56d921]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc5c99-462c-4cdf-9dc0-ba7864eec6e1]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[27471e8d-d389-4a95-b701-1a44cbd8c2ae]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c87536-0ab2-4db5-917e-13b2804be0c1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260]
Nov 08 19:07:56 user nova-compute[74820]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048, portal: 172.16.0.220,3260] successful.
Nov 08 19:07:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71ce4cb-63c1-4a02-8e19-1345997f5048 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbcc323-71f1-49d4-ab89-d18e4c522e35]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] <== disconnect_volume: return (288ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:07:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:07:57 user nova-compute[74820]: DEBUG nova.objects.instance [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'flavor' on Instance uuid 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:07:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-33bd3587-b86e-4478-8124-e873aff78eea tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.074s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:07:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:07:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:07:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:07:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:07:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:07:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:08:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:08:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:18 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:08:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:08:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:22 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:08:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [{"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-d8b61294-3a44-449f-a144-08a0f0cf3555" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:08:24 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:25 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:26 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:08:26 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=25.056713104248047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance d8b61294-3a44-449f-a144-08a0f0cf3555 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 19:08:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:28 user nova-compute[74820]: INFO nova.compute.manager [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Terminating instance
Nov 08 19:08:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-636ac41f-af0c-44a0-9012-ef71c097e855 req-0dd05752-ff46-4266-9cbf-f59af264359f service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-636ac41f-af0c-44a0-9012-ef71c097e855 req-0dd05752-ff46-4266-9cbf-f59af264359f service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-636ac41f-af0c-44a0-9012-ef71c097e855 req-0dd05752-ff46-4266-9cbf-f59af264359f service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-636ac41f-af0c-44a0-9012-ef71c097e855 req-0dd05752-ff46-4266-9cbf-f59af264359f service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-636ac41f-af0c-44a0-9012-ef71c097e855 req-0dd05752-ff46-4266-9cbf-f59af264359f service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.compute.manager [req-636ac41f-af0c-44a0-9012-ef71c097e855 req-0dd05752-ff46-4266-9cbf-f59af264359f service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-unplugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Instance destroyed successfully.
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.objects.instance [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'resources' on Instance uuid d8b61294-3a44-449f-a144-08a0f0cf3555 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-157022144',display_name='tempest-AttachVolumeTestJSON-server-157022144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-157022144',id=47,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJspMb7TaP+2fJRqofXr+WshQoZcsDlpz50Ro0DUk9On5TAIp4gRuompr5LVTh1lqI2/wQj2qo+ZZzj+plERvxECoTuV2nWjecqhZF0j2xH1YCiF/rP25lTB9ajrqKj2Qw==',key_name='tempest-keypair-1477551648',keypairs=<?>,launch_index=0,launched_at=2023-11-08T18:57:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-1gsh0flp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=d8b61294-3a44-449f-a144-08a0f0cf3555,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "address": "fa:16:3e:07:10:f3", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3891dc09-a8", "ovs_interfaceid": "3891dc09-a81a-4a24-8355-fffc51ab7d53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG os_vif [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3891dc09-a8, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=729b9c30-df9c-4cbd-addd-c1cb87863b04) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:29 user nova-compute[74820]: INFO os_vif [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:10:f3,bridge_name='br-int',has_traffic_filtering=True,id=3891dc09-a81a-4a24-8355-fffc51ab7d53,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3891dc09-a8')
Nov 08 19:08:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Deleting instance files /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555_del
Nov 08 19:08:29 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Deletion of /opt/stack/data/nova/instances/d8b61294-3a44-449f-a144-08a0f0cf3555_del complete
Nov 08 19:08:29 user nova-compute[74820]: INFO nova.compute.manager [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 08 19:08:29 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 19:08:29 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 19:08:30 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:08:30 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Took 0.77 seconds to deallocate network for instance.
Nov 08 19:08:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:08:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:08:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:30 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Deleted allocations for instance d8b61294-3a44-449f-a144-08a0f0cf3555
Nov 08 19:08:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-75201543-c3be-48f6-bba6-89ac1d0d1f18 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:08:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] Acquiring lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] Lock "d8b61294-3a44-449f-a144-08a0f0cf3555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] No waiting events found dispatching network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:08:31 user nova-compute[74820]: WARNING nova.compute.manager [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received unexpected event network-vif-plugged-3891dc09-a81a-4a24-8355-fffc51ab7d53 for instance with vm_state deleted and task_state None.
Nov 08 19:08:31 user nova-compute[74820]: DEBUG nova.compute.manager [req-8de04d16-f360-4aa1-8209-cef2466bd650 req-e872d68e-2742-4c61-8e26-517a04b55758 service nova] [instance: d8b61294-3a44-449f-a144-08a0f0cf3555] Received event network-vif-deleted-3891dc09-a81a-4a24-8355-fffc51ab7d53 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:08:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 19:08:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:08:37 user nova-compute[74820]: INFO nova.compute.manager [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] instance snapshotting
Nov 08 19:08:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Beginning live snapshot process
Nov 08 19:08:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json -f qcow2 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2f08yf9h/b5a49375b4c24cc09fcffc39679c140a.delta 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2f08yf9h/b5a49375b4c24cc09fcffc39679c140a.delta 1073741824" returned: 0 in 0.046s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:38 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 19:08:38 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 19:08:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74820) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 19:08:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 19:08:39 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 19:08:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2f08yf9h/b5a49375b4c24cc09fcffc39679c140a.delta /opt/stack/data/nova/instances/snapshots/tmp2f08yf9h/b5a49375b4c24cc09fcffc39679c140a {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2f08yf9h/b5a49375b4c24cc09fcffc39679c140a.delta /opt/stack/data/nova/instances/snapshots/tmp2f08yf9h/b5a49375b4c24cc09fcffc39679c140a" returned: 0 in 0.662s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:40 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Snapshot extracted, beginning image upload
Nov 08 19:08:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:08:42 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Snapshot image upload complete
Nov 08 19:08:42 user nova-compute[74820]: INFO nova.compute.manager [None req-8c5a6e3d-7f61-40a0-943b-e423a6747fd2 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Took 5.18 seconds to snapshot the instance on the hypervisor.
Nov 08 19:08:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 19:08:45 user nova-compute[74820]: INFO nova.compute.claims [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Claim successful on node user
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.network.neutron [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 19:08:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.policy [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8b0241004ce41c5a1a6c84f4b3465ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df34dac541940fdaee1e9eb0416c3f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 19:08:45 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Creating image(s)
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "/opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "/opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "8470fa56174e64d81eb9823279bc4f4e60809ac0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "8470fa56174e64d81eb9823279bc4f4e60809ac0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.part --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:46 user nova-compute[74820]: DEBUG nova.network.neutron [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Successfully created port: 76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 19:08:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:46 user nova-compute[74820]: DEBUG nova.virt.images [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] b214c76f-7ffa-47fe-8ee8-108dcd1eac20 was qcow2, converting to raw {{(pid=74820) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 19:08:46 user nova-compute[74820]: DEBUG nova.privsep.utils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74820) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 19:08:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.part /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.converted {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Successfully updated port: 76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.part /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.converted" returned: 0 in 1.012s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.converted --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-changed-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.compute.manager [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Refreshing instance network info cache due to event network-changed-76e7e88c-00fa-4946-abc4-b80a9fa815eb. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] Acquiring lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] Acquired lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Refreshing network info cache for port 76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "8470fa56174e64d81eb9823279bc4f4e60809ac0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.254s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.network.neutron [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-6d1920ac-c66a-455c-8a9c-fd3afab486e2 req-31d7b715-06c3-4dcc-a569-e7e50506dc0c service nova] Releasing lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquired lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:08:47 user nova-compute[74820]: DEBUG nova.network.neutron [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0 --force-share --output=json" returned: 0 in 0.191s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "8470fa56174e64d81eb9823279bc4f4e60809ac0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "8470fa56174e64d81eb9823279bc4f4e60809ac0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0 --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0,backing_fmt=raw /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.network.neutron [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating instance_info_cache with network_info: [{"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0,backing_fmt=raw /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk 1073741824" returned: 0 in 0.062s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "8470fa56174e64d81eb9823279bc4f4e60809ac0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0 --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Releasing lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Instance network_info: |[{"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8470fa56174e64d81eb9823279bc4f4e60809ac0 --force-share --output=json" returned: 0 in 0.176s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Ensure instance console log exists: /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Start _get_guest_xml network_info=[{"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bcdee8b3243add34e6eacb5d5b687b8e',container_format='bare',created_at=2023-11-08T19:08:37Z,direct_url=<?>,disk_format='qcow2',id=b214c76f-7ffa-47fe-8ee8-108dcd1eac20,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-186954596',owner='8df34dac541940fdaee1e9eb0416c3f8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T19:08:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'b214c76f-7ffa-47fe-8ee8-108dcd1eac20'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 19:08:48 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:08:48 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bcdee8b3243add34e6eacb5d5b687b8e',container_format='bare',created_at=2023-11-08T19:08:37Z,direct_url=<?>,disk_format='qcow2',id=b214c76f-7ffa-47fe-8ee8-108dcd1eac20,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-186954596',owner='8df34dac541940fdaee1e9eb0416c3f8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T19:08:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1388901895',display_name='tempest-TestStampPattern-server-1388901895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1388901895',id=50,image_ref='b214c76f-7ffa-47fe-8ee8-108dcd1eac20',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Xz7HvuURkpQOW7B43HGiIZ6U9KG82L8l49gJ07K7KfnFUOaCugkIB6ZWljH9GuN9Bf7bDRJQjatX4jOFi1PJo04eQ40g/KkkxzLnHomEOqP8jhie2dM0OYzj4eed/uQ==',key_name='tempest-TestStampPattern-614517520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df34dac541940fdaee1e9eb0416c3f8',ramdisk_id='',reservation_id='r-r3x8sowt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='445de213-a08f-40f8-82be-e6f8e7570cac',image_min_disk='1',image_min_ram='0',image_owner_id='8df34dac541940fdaee1e9eb0416c3f8',image_owner_project_name='tempest-TestStampPattern-429227582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-429227582-project-member',image_user_id='e8b0241004ce41c5a1a6c84f4b3465ac',network_allocated='True',owner_project_name='tempest-TestStampPattern-429227582',owner_user_name='tempest-TestStampPattern-429227582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:08:46Z,user_data=None,user_id='e8b0241004ce41c5a1a6c84f4b3465ac',uuid=9ea7bfc4-148f-4166-8a6e-5ca3d8264825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converting VIF {"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.objects.instance [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] End _get_guest_xml xml=<domain type="kvm">
Nov 08 19:08:48 user nova-compute[74820]:   <uuid>9ea7bfc4-148f-4166-8a6e-5ca3d8264825</uuid>
Nov 08 19:08:48 user nova-compute[74820]:   <name>instance-00000032</name>
Nov 08 19:08:48 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 19:08:48 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 19:08:48 user nova-compute[74820]:   <metadata>
Nov 08 19:08:48 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 19:08:48 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 19:08:48 user nova-compute[74820]:       <nova:name>tempest-TestStampPattern-server-1388901895</nova:name>
Nov 08 19:08:48 user nova-compute[74820]:       <nova:creationTime>2023-11-08 19:08:48</nova:creationTime>
Nov 08 19:08:48 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 19:08:48 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 19:08:48 user nova-compute[74820]:       </nova:flavor>
Nov 08 19:08:48 user nova-compute[74820]:       <nova:owner>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:user uuid="e8b0241004ce41c5a1a6c84f4b3465ac">tempest-TestStampPattern-429227582-project-member</nova:user>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:project uuid="8df34dac541940fdaee1e9eb0416c3f8">tempest-TestStampPattern-429227582</nova:project>
Nov 08 19:08:48 user nova-compute[74820]:       </nova:owner>
Nov 08 19:08:48 user nova-compute[74820]:       <nova:root type="image" uuid="b214c76f-7ffa-47fe-8ee8-108dcd1eac20"/>
Nov 08 19:08:48 user nova-compute[74820]:       <nova:ports>
Nov 08 19:08:48 user nova-compute[74820]:         <nova:port uuid="76e7e88c-00fa-4946-abc4-b80a9fa815eb">
Nov 08 19:08:48 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 19:08:48 user nova-compute[74820]:         </nova:port>
Nov 08 19:08:48 user nova-compute[74820]:       </nova:ports>
Nov 08 19:08:48 user nova-compute[74820]:     </nova:instance>
Nov 08 19:08:48 user nova-compute[74820]:   </metadata>
Nov 08 19:08:48 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 19:08:48 user nova-compute[74820]:     <system>
Nov 08 19:08:48 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 19:08:48 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 19:08:48 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 19:08:48 user nova-compute[74820]:       <entry name="serial">9ea7bfc4-148f-4166-8a6e-5ca3d8264825</entry>
Nov 08 19:08:48 user nova-compute[74820]:       <entry name="uuid">9ea7bfc4-148f-4166-8a6e-5ca3d8264825</entry>
Nov 08 19:08:48 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 19:08:48 user nova-compute[74820]:     </system>
Nov 08 19:08:48 user nova-compute[74820]:   </sysinfo>
Nov 08 19:08:48 user nova-compute[74820]:   <os>
Nov 08 19:08:48 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 19:08:48 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 19:08:48 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 19:08:48 user nova-compute[74820]:   </os>
Nov 08 19:08:48 user nova-compute[74820]:   <features>
Nov 08 19:08:48 user nova-compute[74820]:     <acpi/>
Nov 08 19:08:48 user nova-compute[74820]:     <apic/>
Nov 08 19:08:48 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 19:08:48 user nova-compute[74820]:   </features>
Nov 08 19:08:48 user nova-compute[74820]:   <clock offset="utc">
Nov 08 19:08:48 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 19:08:48 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 19:08:48 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 19:08:48 user nova-compute[74820]:   </clock>
Nov 08 19:08:48 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 19:08:48 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 19:08:48 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 19:08:48 user nova-compute[74820]:   </cpu>
Nov 08 19:08:48 user nova-compute[74820]:   <devices>
Nov 08 19:08:48 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 19:08:48 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 19:08:48 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk"/>
Nov 08 19:08:48 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 19:08:48 user nova-compute[74820]:     </disk>
Nov 08 19:08:48 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 19:08:48 user nova-compute[74820]:       <mac address="fa:16:3e:de:39:bf"/>
Nov 08 19:08:48 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:08:48 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 19:08:48 user nova-compute[74820]:       <target dev="tap76e7e88c-00"/>
Nov 08 19:08:48 user nova-compute[74820]:     </interface>
Nov 08 19:08:48 user nova-compute[74820]:     <serial type="pty">
Nov 08 19:08:48 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/console.log" append="off"/>
Nov 08 19:08:48 user nova-compute[74820]:     </serial>
Nov 08 19:08:48 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 19:08:48 user nova-compute[74820]:     <video>
Nov 08 19:08:48 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:08:48 user nova-compute[74820]:     </video>
Nov 08 19:08:48 user nova-compute[74820]:     <rng model="virtio">
Nov 08 19:08:48 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 19:08:48 user nova-compute[74820]:     </rng>
Nov 08 19:08:48 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 19:08:48 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 19:08:48 user nova-compute[74820]:       <stats period="10"/>
Nov 08 19:08:48 user nova-compute[74820]:     </memballoon>
Nov 08 19:08:48 user nova-compute[74820]:   </devices>
Nov 08 19:08:48 user nova-compute[74820]: </domain>
Nov 08 19:08:48 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1388901895',display_name='tempest-TestStampPattern-server-1388901895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1388901895',id=50,image_ref='b214c76f-7ffa-47fe-8ee8-108dcd1eac20',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Xz7HvuURkpQOW7B43HGiIZ6U9KG82L8l49gJ07K7KfnFUOaCugkIB6ZWljH9GuN9Bf7bDRJQjatX4jOFi1PJo04eQ40g/KkkxzLnHomEOqP8jhie2dM0OYzj4eed/uQ==',key_name='tempest-TestStampPattern-614517520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df34dac541940fdaee1e9eb0416c3f8',ramdisk_id='',reservation_id='r-r3x8sowt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='445de213-a08f-40f8-82be-e6f8e7570cac',image_min_disk='1',image_min_ram='0',image_owner_id='8df34dac541940fdaee1e9eb0416c3f8',image_owner_project_name='tempest-TestStampPattern-429227582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-429227582-project-member',image_user_id='e8b0241004ce41c5a1a6c84f4b3465ac',network_allocated='True',owner_project_name='tempest-TestStampPattern-429227582',owner_user_name='tempest-TestStampPattern-429227582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:08:46Z,user_data=None,user_id='e8b0241004ce41c5a1a6c84f4b3465ac',uuid=9ea7bfc4-148f-4166-8a6e-5ca3d8264825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converting VIF {"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG os_vif [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04953e1f-388d-500e-a1c4-f3cceb1a9361', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76e7e88c-00, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76e7e88c-00, col_values=(('qos', UUID('e791d4d4-d0b4-491c-b22f-441ee4068d97')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76e7e88c-00, col_values=(('external_ids', {'iface-id': '76e7e88c-00fa-4946-abc4-b80a9fa815eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:39:bf', 'vm-uuid': '9ea7bfc4-148f-4166-8a6e-5ca3d8264825'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:48 user nova-compute[74820]: INFO os_vif [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00')
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:08:48 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No VIF found with MAC fa:16:3e:de:39:bf, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:08:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-e03cfd83-bcfa-4793-bea5-b7d6fc6db61a req-eb6852c7-013d-4496-aa4a-2775d05831a8 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e03cfd83-bcfa-4793-bea5-b7d6fc6db61a req-eb6852c7-013d-4496-aa4a-2775d05831a8 service nova] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e03cfd83-bcfa-4793-bea5-b7d6fc6db61a req-eb6852c7-013d-4496-aa4a-2775d05831a8 service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e03cfd83-bcfa-4793-bea5-b7d6fc6db61a req-eb6852c7-013d-4496-aa4a-2775d05831a8 service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:50 user nova-compute[74820]: DEBUG nova.compute.manager [req-e03cfd83-bcfa-4793-bea5-b7d6fc6db61a req-eb6852c7-013d-4496-aa4a-2775d05831a8 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] No waiting events found dispatching network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:08:50 user nova-compute[74820]: WARNING nova.compute.manager [req-e03cfd83-bcfa-4793-bea5-b7d6fc6db61a req-eb6852c7-013d-4496-aa4a-2775d05831a8 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received unexpected event network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb for instance with vm_state building and task_state spawning.
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 19:08:52 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Instance spawned successfully.
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:08:52 user nova-compute[74820]: INFO nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:08:52 user nova-compute[74820]: INFO nova.compute.manager [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Took 7.04 seconds to build instance.
Nov 08 19:08:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-39b22c03-5a76-4e03-808f-b211c9e09712 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.131s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4111003-0aad-4487-a21d-68b985cd41b6 req-5524e45f-a585-4805-9035-0ab7a6c593e1 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4111003-0aad-4487-a21d-68b985cd41b6 req-5524e45f-a585-4805-9035-0ab7a6c593e1 service nova] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4111003-0aad-4487-a21d-68b985cd41b6 req-5524e45f-a585-4805-9035-0ab7a6c593e1 service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-e4111003-0aad-4487-a21d-68b985cd41b6 req-5524e45f-a585-4805-9035-0ab7a6c593e1 service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:08:52 user nova-compute[74820]: DEBUG nova.compute.manager [req-e4111003-0aad-4487-a21d-68b985cd41b6 req-5524e45f-a585-4805-9035-0ab7a6c593e1 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] No waiting events found dispatching network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:08:52 user nova-compute[74820]: WARNING nova.compute.manager [req-e4111003-0aad-4487-a21d-68b985cd41b6 req-5524e45f-a585-4805-9035-0ab7a6c593e1 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received unexpected event network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb for instance with vm_state active and task_state None.
Nov 08 19:08:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:08:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:09:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:12 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:15 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:16 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:19 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:09:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 19:09:22 user nova-compute[74820]: INFO nova.compute.claims [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Claim successful on node user
Nov 08 19:09:22 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:09:22 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 19:09:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.policy [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5686817e320e4e0bb7fd71fae1a375c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a7b594e4b4ff3bb52470b1920e127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 19:09:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Creating image(s)
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "/opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "/opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "/opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk 1073741824" returned: 0 in 0.046s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Cannot resize image /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Ensure instance console log exists: /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:23 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Successfully created port: 58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Successfully updated port: 58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquired lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-changed-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.compute.manager [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Refreshing instance network info cache due to event network-changed-58b312da-b08c-4cff-aad9-9477f7154a00. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] Acquiring lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating instance_info_cache with network_info: [{"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Releasing lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Instance network_info: |[{"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] Acquired lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.network.neutron [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Refreshing network info cache for port 58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Start _get_guest_xml network_info=[{"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 19:09:24 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:09:24 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 19:09:24 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-813170300',display_name='tempest-AttachVolumeTestJSON-server-813170300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-813170300',id=51,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExrH5rBgSZd1xPM6h1WaG2PFBlI3ZT069LAqZjjDbaqMw2q2XZZ4lvzPHnMCTQd+GceCY91W3mbirNsIX5oPxgVKThyUS47XfALLaxlaq+iOqm1IoLp2Ps+wGusLocevw==',key_name='tempest-keypair-1551423877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-sbf0u80w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=13fc31a7-732d-48be-a9d6-f36f39025ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.objects.instance [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'pci_devices' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 19:09:25 user nova-compute[74820]:   <uuid>13fc31a7-732d-48be-a9d6-f36f39025ef2</uuid>
Nov 08 19:09:25 user nova-compute[74820]:   <name>instance-00000033</name>
Nov 08 19:09:25 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 19:09:25 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 19:09:25 user nova-compute[74820]:   <metadata>
Nov 08 19:09:25 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 19:09:25 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 19:09:25 user nova-compute[74820]:       <nova:name>tempest-AttachVolumeTestJSON-server-813170300</nova:name>
Nov 08 19:09:25 user nova-compute[74820]:       <nova:creationTime>2023-11-08 19:09:24</nova:creationTime>
Nov 08 19:09:25 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 19:09:25 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 19:09:25 user nova-compute[74820]:       </nova:flavor>
Nov 08 19:09:25 user nova-compute[74820]:       <nova:owner>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:user uuid="5686817e320e4e0bb7fd71fae1a375c4">tempest-AttachVolumeTestJSON-247912662-project-member</nova:user>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:project uuid="5a9a7b594e4b4ff3bb52470b1920e127">tempest-AttachVolumeTestJSON-247912662</nova:project>
Nov 08 19:09:25 user nova-compute[74820]:       </nova:owner>
Nov 08 19:09:25 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 19:09:25 user nova-compute[74820]:       <nova:ports>
Nov 08 19:09:25 user nova-compute[74820]:         <nova:port uuid="58b312da-b08c-4cff-aad9-9477f7154a00">
Nov 08 19:09:25 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 19:09:25 user nova-compute[74820]:         </nova:port>
Nov 08 19:09:25 user nova-compute[74820]:       </nova:ports>
Nov 08 19:09:25 user nova-compute[74820]:     </nova:instance>
Nov 08 19:09:25 user nova-compute[74820]:   </metadata>
Nov 08 19:09:25 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 19:09:25 user nova-compute[74820]:     <system>
Nov 08 19:09:25 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 19:09:25 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 19:09:25 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 19:09:25 user nova-compute[74820]:       <entry name="serial">13fc31a7-732d-48be-a9d6-f36f39025ef2</entry>
Nov 08 19:09:25 user nova-compute[74820]:       <entry name="uuid">13fc31a7-732d-48be-a9d6-f36f39025ef2</entry>
Nov 08 19:09:25 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 19:09:25 user nova-compute[74820]:     </system>
Nov 08 19:09:25 user nova-compute[74820]:   </sysinfo>
Nov 08 19:09:25 user nova-compute[74820]:   <os>
Nov 08 19:09:25 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 19:09:25 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 19:09:25 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 19:09:25 user nova-compute[74820]:   </os>
Nov 08 19:09:25 user nova-compute[74820]:   <features>
Nov 08 19:09:25 user nova-compute[74820]:     <acpi/>
Nov 08 19:09:25 user nova-compute[74820]:     <apic/>
Nov 08 19:09:25 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 19:09:25 user nova-compute[74820]:   </features>
Nov 08 19:09:25 user nova-compute[74820]:   <clock offset="utc">
Nov 08 19:09:25 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 19:09:25 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 19:09:25 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 19:09:25 user nova-compute[74820]:   </clock>
Nov 08 19:09:25 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 19:09:25 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 19:09:25 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 19:09:25 user nova-compute[74820]:   </cpu>
Nov 08 19:09:25 user nova-compute[74820]:   <devices>
Nov 08 19:09:25 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 19:09:25 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 19:09:25 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk"/>
Nov 08 19:09:25 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 19:09:25 user nova-compute[74820]:     </disk>
Nov 08 19:09:25 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 19:09:25 user nova-compute[74820]:       <mac address="fa:16:3e:c5:04:51"/>
Nov 08 19:09:25 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:09:25 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 19:09:25 user nova-compute[74820]:       <target dev="tap58b312da-b0"/>
Nov 08 19:09:25 user nova-compute[74820]:     </interface>
Nov 08 19:09:25 user nova-compute[74820]:     <serial type="pty">
Nov 08 19:09:25 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/console.log" append="off"/>
Nov 08 19:09:25 user nova-compute[74820]:     </serial>
Nov 08 19:09:25 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 19:09:25 user nova-compute[74820]:     <video>
Nov 08 19:09:25 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:09:25 user nova-compute[74820]:     </video>
Nov 08 19:09:25 user nova-compute[74820]:     <rng model="virtio">
Nov 08 19:09:25 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 19:09:25 user nova-compute[74820]:     </rng>
Nov 08 19:09:25 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 19:09:25 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 19:09:25 user nova-compute[74820]:       <stats period="10"/>
Nov 08 19:09:25 user nova-compute[74820]:     </memballoon>
Nov 08 19:09:25 user nova-compute[74820]:   </devices>
Nov 08 19:09:25 user nova-compute[74820]: </domain>
Nov 08 19:09:25 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-813170300',display_name='tempest-AttachVolumeTestJSON-server-813170300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-813170300',id=51,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExrH5rBgSZd1xPM6h1WaG2PFBlI3ZT069LAqZjjDbaqMw2q2XZZ4lvzPHnMCTQd+GceCY91W3mbirNsIX5oPxgVKThyUS47XfALLaxlaq+iOqm1IoLp2Ps+wGusLocevw==',key_name='tempest-keypair-1551423877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-sbf0u80w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=13fc31a7-732d-48be-a9d6-f36f39025ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG os_vif [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbfb2dbe-d7f3-5ecc-97e0-e9e092f9adc2', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58b312da-b0, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58b312da-b0, col_values=(('qos', UUID('451601d7-bea4-405d-847f-27f5b30d2fdb')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58b312da-b0, col_values=(('external_ids', {'iface-id': '58b312da-b08c-4cff-aad9-9477f7154a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:04:51', 'vm-uuid': '13fc31a7-732d-48be-a9d6-f36f39025ef2'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:25 user nova-compute[74820]: INFO os_vif [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0')
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No VIF found with MAC fa:16:3e:c5:04:51, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updated VIF entry in instance network info cache for port 58b312da-b08c-4cff-aad9-9477f7154a00. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating instance_info_cache with network_info: [{"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:09:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-a823c75c-5ddb-449d-b2bd-b2599b4fb464 req-7235378e-2c24-49d9-920b-95d220ce569e service nova] Releasing lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-f79de159-2e9a-4f9c-b04d-30c4e4d9b148 req-669bd6b7-eb5c-4997-ab06-dbeb6f9de6eb service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f79de159-2e9a-4f9c-b04d-30c4e4d9b148 req-669bd6b7-eb5c-4997-ab06-dbeb6f9de6eb service nova] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f79de159-2e9a-4f9c-b04d-30c4e4d9b148 req-669bd6b7-eb5c-4997-ab06-dbeb6f9de6eb service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f79de159-2e9a-4f9c-b04d-30c4e4d9b148 req-669bd6b7-eb5c-4997-ab06-dbeb6f9de6eb service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG nova.compute.manager [req-f79de159-2e9a-4f9c-b04d-30c4e4d9b148 req-669bd6b7-eb5c-4997-ab06-dbeb6f9de6eb service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] No waiting events found dispatching network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:09:26 user nova-compute[74820]: WARNING nova.compute.manager [req-f79de159-2e9a-4f9c-b04d-30c4e4d9b148 req-669bd6b7-eb5c-4997-ab06-dbeb6f9de6eb service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received unexpected event network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 for instance with vm_state building and task_state spawning.
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:26 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:27 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-2a8139f1-f858-4237-af23-064127ab967e req-2e9bd8b4-9fb3-46bb-92fb-342c77319819 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2a8139f1-f858-4237-af23-064127ab967e req-2e9bd8b4-9fb3-46bb-92fb-342c77319819 service nova] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2a8139f1-f858-4237-af23-064127ab967e req-2e9bd8b4-9fb3-46bb-92fb-342c77319819 service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-2a8139f1-f858-4237-af23-064127ab967e req-2e9bd8b4-9fb3-46bb-92fb-342c77319819 service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.manager [req-2a8139f1-f858-4237-af23-064127ab967e req-2e9bd8b4-9fb3-46bb-92fb-342c77319819 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] No waiting events found dispatching network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:09:28 user nova-compute[74820]: WARNING nova.compute.manager [req-2a8139f1-f858-4237-af23-064127ab967e req-2e9bd8b4-9fb3-46bb-92fb-342c77319819 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received unexpected event network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 for instance with vm_state building and task_state spawning.
Nov 08 19:09:28 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Instance spawned successfully.
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 19:09:28 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:09:28 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=24.92977523803711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:09:28 user nova-compute[74820]: INFO nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:09:28 user nova-compute[74820]: INFO nova.compute.manager [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Took 6.21 seconds to build instance.
Nov 08 19:09:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-07449677-7c31-4b3d-9461-a1bde4b61b9b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.303s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:09:28 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:09:29 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:09:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:09:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:09:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:09:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:09:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:09:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:09:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:09:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:10:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:10:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:10:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:17 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:20 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:10:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:10:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:10:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:10:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:10:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:10:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:10:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:10:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:10:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:10:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:10:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.90078353881836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:10:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:10:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-changed-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:10:36 user nova-compute[74820]: DEBUG nova.compute.manager [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Refreshing instance network info cache due to event network-changed-76e7e88c-00fa-4946-abc4-b80a9fa815eb. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:10:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] Acquiring lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:10:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] Acquired lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:10:36 user nova-compute[74820]: DEBUG nova.network.neutron [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Refreshing network info cache for port 76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updated VIF entry in instance network info cache for port 76e7e88c-00fa-4946-abc4-b80a9fa815eb. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating instance_info_cache with network_info: [{"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-9245c1f3-6682-4380-9190-074a6d89b397 req-a0a4397b-db01-49c5-8f2e-71eb30309525 service nova] Releasing lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'flavor' on Instance uuid 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:10:37 user nova-compute[74820]: INFO nova.compute.manager [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Attaching volume f993c86c-b8e2-45be-a1d4-6ed599d8e6cc to /dev/vdb
Nov 08 19:10:37 user nova-compute[74820]: DEBUG os_brick.utils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18ca335-66aa-451b-8693-4c239a368006]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c41459-555a-4e70-9b80-d80a05384582]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e15eb-bfe0-4e8d-bfab-62296a68d2d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754eb87-d875-47b3-b88e-b014ecd52738]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:10:37 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:10:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6895e011-56ed-4c25-af24-cb3f3844534b]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG os_brick.utils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:10:37 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating existing volume attachment record: ddce4e28-2542-4504-8a92-1b201f34def5 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:10:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:10:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:10:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:10:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:55 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMVAaCrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:10:58 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:10:58 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:10:58 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c21f5f-64a2-4d8c-8c00-43ffc113c8cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:10:58 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb4f72-6ab6-4bcc-8b1e-9bcea0800e2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc] added
Nov 08 19:10:58 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a138405-f15f-4c99-9b65-2a7b66227de9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:58 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9d024a-dfd7-4ff6-98a7-fe6492812bbe]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMVAaCrQ {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMVAaCrQ" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddd0d36-71bd-4185-bf20-9f384c09a24e]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMVAaCrQ'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837bc7d-d22d-49ce-ac9e-6df02e2ac58b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3a536c-9a10-434e-b31b-82011eb755d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:10:59 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:10:59 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:10:59 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:10:59 user nova-compute[74820]: 
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b5c6c-0c4f-4470-93d7-f68f7f077655]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260]
Nov 08 19:10:59 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260] successful.
Nov 08 19:10:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b153aa-d017-4f01-a546-fccdab6a3406]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8743e77b-8168-41b8-aecc-a247fa62d841]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc (non-flash)
Nov 08 19:10:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc (non-flash)
Nov 08 19:10:59 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29bdaa-98ef-4bea-89fc-2c6208b8767b]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:10:59 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMVAaCrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26234306232343763', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234306232343763', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG nova.objects.instance [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'flavor' on Instance uuid 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:11:00 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:11:00 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:11:00 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:11:00 user nova-compute[74820]:   <serial>f993c86c-b8e2-45be-a1d4-6ed599d8e6cc</serial>
Nov 08 19:11:00 user nova-compute[74820]: </disk>
Nov 08 19:11:00 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] No VIF found with MAC fa:16:3e:de:39:bf, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:11:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-f096ed63-abcc-4953-bd82-8c952e3ee279 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.198s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:02 user nova-compute[74820]: INFO nova.compute.manager [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Detaching volume f993c86c-b8e2-45be-a1d4-6ed599d8e6cc
Nov 08 19:11:02 user nova-compute[74820]: INFO nova.virt.block_device [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Attempting to driver detach volume f993c86c-b8e2-45be-a1d4-6ed599d8e6cc from mountpoint /dev/vdb
Nov 08 19:11:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Attempting to detach device vdb from instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:11:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:11:02 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:11:02 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:11:02 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:11:02 user nova-compute[74820]:   <serial>f993c86c-b8e2-45be-a1d4-6ed599d8e6cc</serial>
Nov 08 19:11:02 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:11:02 user nova-compute[74820]: </disk>
Nov 08 19:11:02 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:11:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully detached device vdb from instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 from the persistent domain config.
Nov 08 19:11:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:11:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:11:02 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:11:02 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:11:02 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:11:02 user nova-compute[74820]:   <serial>f993c86c-b8e2-45be-a1d4-6ed599d8e6cc</serial>
Nov 08 19:11:02 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:11:02 user nova-compute[74820]: </disk>
Nov 08 19:11:02 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:11:03 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:11:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:10 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-changed-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:11:13 user nova-compute[74820]: DEBUG nova.compute.manager [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Refreshing instance network info cache due to event network-changed-58b312da-b08c-4cff-aad9-9477f7154a00. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:11:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] Acquiring lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:11:13 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] Acquired lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:11:13 user nova-compute[74820]: DEBUG nova.network.neutron [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Refreshing network info cache for port 58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:11:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updated VIF entry in instance network info cache for port 58b312da-b08c-4cff-aad9-9477f7154a00. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:11:14 user nova-compute[74820]: DEBUG nova.network.neutron [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating instance_info_cache with network_info: [{"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:11:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-d3d8c9c4-3251-4c64-bed9-32d7180be7d9 req-59a6d906-9d9f-4f04-a569-1e18c8c46d94 service nova] Releasing lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:11:15 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG nova.objects.instance [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:19 user nova-compute[74820]: INFO nova.compute.manager [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attaching volume db409a60-4528-4f98-864f-592df21407f9 to /dev/vdb
Nov 08 19:11:19 user nova-compute[74820]: DEBUG os_brick.utils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd9485a-e6b6-4744-af40-bf91111bd509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:19 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa68371-75bf-4c8d-98a4-d6f132e72590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[421067d9-7e5e-4d9f-bc1b-1ba572a37343]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df4c098-df66-4443-bca8-4e5adbb66d53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:11:20 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9647355f-e19d-4e41-b3c5-4f1b06f42c49]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG os_brick.utils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating existing volume attachment record: 295eda35-420d-461c-8f74-5dcd34ba9e01 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:21 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:11:23 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 is timed out.
Nov 08 19:11:23 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully detached device vdb from instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 from the live domain config.
Nov 08 19:11:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMVAaCrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:11:23 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef31db33-9c1f-4846-882c-1f8d37c453fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:11:23 user nova-compute[74820]: No targets found.
Nov 08 19:11:23 user nova-compute[74820]: iSNS:
Nov 08 19:11:23 user nova-compute[74820]: No targets found.
Nov 08 19:11:23 user nova-compute[74820]: STATIC:
Nov 08 19:11:23 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc
Nov 08 19:11:23 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:11:23 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:11:23 user nova-compute[74820]: FIRMWARE:
Nov 08 19:11:23 user nova-compute[74820]: No targets found.
Nov 08 19:11:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:11:23 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:11:23 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42394dc-4ea0-4ed5-8ba2-bc8962dea96b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef3bd9-44c9-409e-8e2e-7fad33df4e12]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc (non-flash)
Nov 08 19:11:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc (non-flash)
Nov 08 19:11:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2822f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e47493-60af-4e2a-9d9c-7afd49610a3b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f5b82d-bd7d-485e-a6d1-71d7bcddc11a]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5571dd-2188-4707-92f7-dcc24afa7575]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f277508-315e-4edf-8137-560e5646ce58]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c97277-9034-4c9a-9499-8bee57e352b0]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e1647-2a4c-4848-afeb-2098b76c3b1e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260]
Nov 08 19:11:23 user nova-compute[74820]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc, portal: 172.16.0.220,3260] successful.
Nov 08 19:11:23 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f993c86c-b8e2-45be-a1d4-6ed599d8e6cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f82797-6d1f-4a0a-809d-baae13218a1b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] <== disconnect_volume: return (292ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:11:23 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG nova.objects.instance [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'flavor' on Instance uuid 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-adc0e4ce-9457-42cf-8320-08eae7fcdf07 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.810s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:11:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:11:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating instance_info_cache with network_info: [{"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:11:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:11:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:11:25 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:11:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:28 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:28 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:11:28 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:29 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:11:30 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=24.899303436279297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:11:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:35 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:11:40 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnsrJAax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:11:41 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:11:41 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:11:41 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7680557-73e6-4691-a9ae-9d2491a745fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:11:41 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569269a-a647-42a1-b98b-fbb401160686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9] added
Nov 08 19:11:41 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0418ebd4-a05b-43fd-b93f-784f1f5784c2]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dacd59f-f53b-461a-95c3-ab4593b9be7a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnsrJAax {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnsrJAax" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b147a80e-c525-49e5-8add-c2dc06c2a28c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnsrJAax'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9532cf-4ea3-47b9-b4f2-7bc05f23cf64]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8f0c3a-fd06-4dd7-a779-78e6070b93d2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:11:41 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:11:41 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:11:41 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:11:41 user nova-compute[74820]: 
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1316578b-f2a4-4b27-b09e-7f4df3b27be3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260]
Nov 08 19:11:41 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260] successful.
Nov 08 19:11:41 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a767a8-c40a-439d-a698-35c0fcb19371]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ee0c5-e125-4834-8a87-78c4cc6b4590]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:11:41 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:11:41 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ea2d7-14ed-4abb-9941-4700641fbaed]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:11:41 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnsrJAax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:11:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:11:42 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23066623364323539', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:11:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623364323539', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:11:42 user nova-compute[74820]: DEBUG nova.objects.instance [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:11:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:11:42 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:11:42 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:11:42 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:11:42 user nova-compute[74820]:   <serial>db409a60-4528-4f98-864f-592df21407f9</serial>
Nov 08 19:11:42 user nova-compute[74820]: </disk>
Nov 08 19:11:42 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:11:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:11:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:11:43 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No VIF found with MAC fa:16:3e:c5:04:51, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:11:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-58a97c65-118a-46d5-ba28-712f644e82aa tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.271s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:49 user nova-compute[74820]: INFO nova.compute.manager [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attaching volume 45c63636-9b1f-491b-8e13-0b9cde98c37e to /dev/vdc
Nov 08 19:11:49 user nova-compute[74820]: DEBUG os_brick.utils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b60e25-c446-4f6a-ab9f-49088a38d6a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f574ab-37b8-46af-8f0d-810cc927ebe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087c32d-38ec-463a-ba0c-dba9a4d59f56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67068f0-d790-49d6-b792-a86eaf9c8a59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:11:49 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:11:49 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ea4ea-91f8-48e1-916d-c013c5278f76]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG os_brick.utils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:11:49 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating existing volume attachment record: 4e4a70a8-6032-47e2-adf6-5cab1d7b85e4 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:11:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-changed-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Refreshing instance network info cache due to event network-changed-76e7e88c-00fa-4946-abc4-b80a9fa815eb. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] Acquiring lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] Acquired lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.network.neutron [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Refreshing network info cache for port 76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:53 user nova-compute[74820]: INFO nova.compute.manager [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Terminating instance
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-40aa09ed-35e0-4fc0-a595-7fe7f882c1b3 req-b4e6c45d-6010-4b36-9846-2d5e202755fe service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-vif-unplugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40aa09ed-35e0-4fc0-a595-7fe7f882c1b3 req-b4e6c45d-6010-4b36-9846-2d5e202755fe service nova] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40aa09ed-35e0-4fc0-a595-7fe7f882c1b3 req-b4e6c45d-6010-4b36-9846-2d5e202755fe service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-40aa09ed-35e0-4fc0-a595-7fe7f882c1b3 req-b4e6c45d-6010-4b36-9846-2d5e202755fe service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-40aa09ed-35e0-4fc0-a595-7fe7f882c1b3 req-b4e6c45d-6010-4b36-9846-2d5e202755fe service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] No waiting events found dispatching network-vif-unplugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-40aa09ed-35e0-4fc0-a595-7fe7f882c1b3 req-b4e6c45d-6010-4b36-9846-2d5e202755fe service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-vif-unplugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.network.neutron [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updated VIF entry in instance network info cache for port 76e7e88c-00fa-4946-abc4-b80a9fa815eb. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG nova.network.neutron [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating instance_info_cache with network_info: [{"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:11:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-8df99fde-3de7-48f9-b54a-9cfb49f0b36a req-cc155312-fa33-4830-a10c-e28442fa120f service nova] Releasing lock "refresh_cache-9ea7bfc4-148f-4166-8a6e-5ca3d8264825" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:11:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Instance destroyed successfully.
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.objects.instance [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'resources' on Instance uuid 9ea7bfc4-148f-4166-8a6e-5ca3d8264825 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:08:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1388901895',display_name='tempest-TestStampPattern-server-1388901895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1388901895',id=50,image_ref='b214c76f-7ffa-47fe-8ee8-108dcd1eac20',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Xz7HvuURkpQOW7B43HGiIZ6U9KG82L8l49gJ07K7KfnFUOaCugkIB6ZWljH9GuN9Bf7bDRJQjatX4jOFi1PJo04eQ40g/KkkxzLnHomEOqP8jhie2dM0OYzj4eed/uQ==',key_name='tempest-TestStampPattern-614517520',keypairs=<?>,launch_index=0,launched_at=2023-11-08T19:08:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8df34dac541940fdaee1e9eb0416c3f8',ramdisk_id='',reservation_id='r-r3x8sowt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='445de213-a08f-40f8-82be-e6f8e7570cac',image_min_disk='1',image_min_ram='0',image_owner_id='8df34dac541940fdaee1e9eb0416c3f8',image_owner_project_name='tempest-TestStampPattern-429227582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-429227582-project-member',image_user_id='e8b0241004ce41c5a1a6c84f4b3465ac',owner_project_name='tempest-TestStampPattern-429227582',owner_user_name='tempest-TestStampPattern-429227582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:08:52Z,user_data=None,user_id='e8b0241004ce41c5a1a6c84f4b3465ac',uuid=9ea7bfc4-148f-4166-8a6e-5ca3d8264825,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converting VIF {"id": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "address": "fa:16:3e:de:39:bf", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e7e88c-00", "ovs_interfaceid": "76e7e88c-00fa-4946-abc4-b80a9fa815eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG os_vif [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76e7e88c-00, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e791d4d4-d0b4-491c-b22f-441ee4068d97) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:11:54 user nova-compute[74820]: INFO os_vif [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:39:bf,bridge_name='br-int',has_traffic_filtering=True,id=76e7e88c-00fa-4946-abc4-b80a9fa815eb,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e7e88c-00')
Nov 08 19:11:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Deleting instance files /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825_del
Nov 08 19:11:54 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Deletion of /opt/stack/data/nova/instances/9ea7bfc4-148f-4166-8a6e-5ca3d8264825_del complete
Nov 08 19:11:54 user nova-compute[74820]: INFO nova.compute.manager [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 19:11:54 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 19:11:54 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:11:54 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Took 0.63 seconds to deallocate network for instance.
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:55 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Deleted allocations for instance 9ea7bfc4-148f-4166-8a6e-5ca3d8264825
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-15231f06-c9f8-417c-b29f-abea5fc601cc tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-8d5551bb-7863-4478-b2a0-71938e7d2a43 req-beaa81b9-1cc0-4754-9da8-6dc494ebd457 service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-vif-deleted-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-fb644e84-2f7c-4896-b1be-a60cb7e18e47 req-e6b9ccff-0923-4b08-ba16-790b12fa47bb service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received event network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fb644e84-2f7c-4896-b1be-a60cb7e18e47 req-e6b9ccff-0923-4b08-ba16-790b12fa47bb service nova] Acquiring lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fb644e84-2f7c-4896-b1be-a60cb7e18e47 req-e6b9ccff-0923-4b08-ba16-790b12fa47bb service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-fb644e84-2f7c-4896-b1be-a60cb7e18e47 req-e6b9ccff-0923-4b08-ba16-790b12fa47bb service nova] Lock "9ea7bfc4-148f-4166-8a6e-5ca3d8264825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:11:55 user nova-compute[74820]: DEBUG nova.compute.manager [req-fb644e84-2f7c-4896-b1be-a60cb7e18e47 req-e6b9ccff-0923-4b08-ba16-790b12fa47bb service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] No waiting events found dispatching network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:11:55 user nova-compute[74820]: WARNING nova.compute.manager [req-fb644e84-2f7c-4896-b1be-a60cb7e18e47 req-e6b9ccff-0923-4b08-ba16-790b12fa47bb service nova] [instance: 9ea7bfc4-148f-4166-8a6e-5ca3d8264825] Received unexpected event network-vif-plugged-76e7e88c-00fa-4946-abc4-b80a9fa815eb for instance with vm_state deleted and task_state None.
Nov 08 19:11:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:12:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:12:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:12:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:12:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQSIqPYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:12:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:12:11 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:12:11 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf3dc82-d233-432c-8f20-148148ea7bd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:12:11 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f1239-612c-47c4-8cbc-af3a9d4dfc64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e] added
Nov 08 19:12:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fccfe8-9c53-4d50-b572-9c36080c78de]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f555ee52-eded-4dd8-a4f7-ebec9368e049]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQSIqPYT {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQSIqPYT" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b85022a-9d2d-4023-a486-e446dd2d098f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQSIqPYT'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aedfcea-123d-45e0-ba9f-e6fef51976da]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ff93e-e350-4f4a-959a-46bbf764eae0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:12:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:12:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[53265b62-1630-4f61-8702-9b257bd6d297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260]
Nov 08 19:12:11 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260] successful.
Nov 08 19:12:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffaa45f-d8bf-4ad4-844a-9c9c93894cb1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4186b8bf-e6e5-4315-814b-fdaa96f072b8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:12:11 user nova-compute[74820]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)
Nov 08 19:12:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:12:11 user nova-compute[74820]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)
Nov 08 19:12:11 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[2466a76f-df69-45a5-bac5-be4909b29413]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:12:11 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQSIqPYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23466336639643064', 'path': '/dev/sdc'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466336639643064', 'path': '/dev/sdc'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:12:12 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:12:12 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 19:12:12 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 19:12:12 user nova-compute[74820]:   <serial>45c63636-9b1f-491b-8e13-0b9cde98c37e</serial>
Nov 08 19:12:12 user nova-compute[74820]: </disk>
Nov 08 19:12:12 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] No VIF found with MAC fa:16:3e:c5:04:51, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:12:12 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9e161521-533b-44f6-b7a3-ea2b4a88ac40 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.663s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:12:14 user nova-compute[74820]: INFO nova.compute.manager [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Detaching volume db409a60-4528-4f98-864f-592df21407f9
Nov 08 19:12:14 user nova-compute[74820]: INFO nova.virt.block_device [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attempting to driver detach volume db409a60-4528-4f98-864f-592df21407f9 from mountpoint /dev/vdb
Nov 08 19:12:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Attempting to detach device vdb from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:12:14 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:12:14 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:12:14 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:12:14 user nova-compute[74820]:   <serial>db409a60-4528-4f98-864f-592df21407f9</serial>
Nov 08 19:12:14 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:12:14 user nova-compute[74820]: </disk>
Nov 08 19:12:14 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:12:14 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully detached device vdb from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the persistent domain config.
Nov 08 19:12:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:12:14 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:12:14 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:12:14 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:12:14 user nova-compute[74820]:   <serial>db409a60-4528-4f98-864f-592df21407f9</serial>
Nov 08 19:12:14 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:12:14 user nova-compute[74820]: </disk>
Nov 08 19:12:14 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:12:14 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:12:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:19 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:12:24 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:12:25 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating instance_info_cache with network_info: [{"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:12:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-13fc31a7-732d-48be-a9d6-f36f39025ef2" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:12:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:12:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:12:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:12:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:12:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:12:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:12:30 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:31 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74820) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 19:12:32 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:12:32 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=24.899208068847656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 445de213-a08f-40f8-82be-e6f8e7570cac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:12:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:12:34 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 is timed out.
Nov 08 19:12:34 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully detached device vdb from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the live domain config.
Nov 08 19:12:34 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnsrJAax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:12:34 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefae7db-d563-4d3b-8852-9261e62c6914]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:12:34 user nova-compute[74820]: No targets found.
Nov 08 19:12:34 user nova-compute[74820]: iSNS:
Nov 08 19:12:34 user nova-compute[74820]: No targets found.
Nov 08 19:12:34 user nova-compute[74820]: STATIC:
Nov 08 19:12:34 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9
Nov 08 19:12:34 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:12:34 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:12:34 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e
Nov 08 19:12:34 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:12:34 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:12:34 user nova-compute[74820]: FIRMWARE:
Nov 08 19:12:34 user nova-compute[74820]: No targets found.
Nov 08 19:12:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:12:34 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:12:34 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5930c2de-0113-4448-ae16-4e64928b2a0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[75af653b-ac80-410c-b49c-ac475327ebbf]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:12:34 user nova-compute[74820]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)
Nov 08 19:12:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 (non-flash)
Nov 08 19:12:34 user nova-compute[74820]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)
Nov 08 19:12:34 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e2822d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:12:34 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0dab3-de9c-45a8-878a-4a22a7f283da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d11ae-8fa0-4a69-a44d-33117ea9706b]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f8fe50-c594-4352-a56a-6647098a3a23]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f88d5e-e00a-4981-ab16-4b76e877d418]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6db01-4de0-4ce6-a5b0-74770da013e1]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef001eec-879f-4d42-90f4-4b4eed53730b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260]
Nov 08 19:12:35 user nova-compute[74820]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9, portal: 172.16.0.220,3260] successful.
Nov 08 19:12:35 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db409a60-4528-4f98-864f-592df21407f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e984c6a-5d64-4193-9742-0d8953888480]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== disconnect_volume: return (278ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:12:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:12:36 user nova-compute[74820]: DEBUG nova.objects.instance [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:12:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-70cf6b03-48b6-4c45-aaab-2a79126b1589 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:12:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:12:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:12:37 user nova-compute[74820]: INFO nova.compute.manager [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Detaching volume 45c63636-9b1f-491b-8e13-0b9cde98c37e
Nov 08 19:12:37 user nova-compute[74820]: INFO nova.virt.block_device [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Attempting to driver detach volume 45c63636-9b1f-491b-8e13-0b9cde98c37e from mountpoint /dev/vdc
Nov 08 19:12:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Attempting to detach device vdc from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:12:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:12:37 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:12:37 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 19:12:37 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 19:12:37 user nova-compute[74820]:   <serial>45c63636-9b1f-491b-8e13-0b9cde98c37e</serial>
Nov 08 19:12:37 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 19:12:37 user nova-compute[74820]: </disk>
Nov 08 19:12:37 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:12:37 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully detached device vdc from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the persistent domain config.
Nov 08 19:12:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:12:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:12:37 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:12:37 user nova-compute[74820]:   <source dev="/dev/sdc"/>
Nov 08 19:12:37 user nova-compute[74820]:   <target dev="vdc" bus="virtio"/>
Nov 08 19:12:37 user nova-compute[74820]:   <serial>45c63636-9b1f-491b-8e13-0b9cde98c37e</serial>
Nov 08 19:12:37 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 19:12:37 user nova-compute[74820]: </disk>
Nov 08 19:12:37 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:12:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:12:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:12:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:12:49 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:12:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:12:57 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 is timed out.
Nov 08 19:12:57 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully detached device vdc from instance 13fc31a7-732d-48be-a9d6-f36f39025ef2 from the live domain config.
Nov 08 19:12:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQSIqPYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:12:57 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdbdd7e-0643-4ab9-95db-cef503fbca48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:12:57 user nova-compute[74820]: No targets found.
Nov 08 19:12:57 user nova-compute[74820]: iSNS:
Nov 08 19:12:57 user nova-compute[74820]: No targets found.
Nov 08 19:12:57 user nova-compute[74820]: STATIC:
Nov 08 19:12:57 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e
Nov 08 19:12:57 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:12:57 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:12:57 user nova-compute[74820]: FIRMWARE:
Nov 08 19:12:57 user nova-compute[74820]: No targets found.
Nov 08 19:12:57 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:12:57 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:12:57 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b86340-c48d-45bb-a21b-accf8a6775d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3bf8bc-bbaf-4edd-97f9-de6cd8edb349]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)
Nov 08 19:12:57 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e (non-flash)
Nov 08 19:12:57 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e401eecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e'): ({'sdc'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Removing single pathed devices sdc {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3602df53-4655-4151-ab36-e7405cecfdfb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc11b93-0281-46fa-b0e4-fbefeb6abfc6]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Flushing IO for device /dev/sdc {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e246f8c-82c0-42af-bafc-a8da9e96424f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4691d816-3c6d-45fb-ba22-818c166e1c29]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] SCSI volumes sdc have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51ebcc-5e69-427b-b2c0-af3e93af49f8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a50c6-06d7-4cf1-9077-c3b768354002]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260]
Nov 08 19:12:57 user nova-compute[74820]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e, portal: 172.16.0.220,3260] successful.
Nov 08 19:12:57 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45c63636-9b1f-491b-8e13-0b9cde98c37e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[26038cd3-74a7-4b14-bcb8-7173e64087de]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] <== disconnect_volume: return (289ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:12:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:12:58 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'flavor' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:12:58 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9bd28b54-896d-46d8-954f-75142794039b tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:12:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:00 user nova-compute[74820]: INFO nova.compute.manager [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Terminating instance
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.compute.manager [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-f3e1ec2f-b358-4e9c-b19c-4e26fdf778a2 req-855dfd52-c108-4ec4-ba0f-d2393aa9052b service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-vif-unplugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f3e1ec2f-b358-4e9c-b19c-4e26fdf778a2 req-855dfd52-c108-4ec4-ba0f-d2393aa9052b service nova] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f3e1ec2f-b358-4e9c-b19c-4e26fdf778a2 req-855dfd52-c108-4ec4-ba0f-d2393aa9052b service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-f3e1ec2f-b358-4e9c-b19c-4e26fdf778a2 req-855dfd52-c108-4ec4-ba0f-d2393aa9052b service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-f3e1ec2f-b358-4e9c-b19c-4e26fdf778a2 req-855dfd52-c108-4ec4-ba0f-d2393aa9052b service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] No waiting events found dispatching network-vif-unplugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.compute.manager [req-f3e1ec2f-b358-4e9c-b19c-4e26fdf778a2 req-855dfd52-c108-4ec4-ba0f-d2393aa9052b service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-vif-unplugged-58b312da-b08c-4cff-aad9-9477f7154a00 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Instance destroyed successfully.
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.objects.instance [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lazy-loading 'resources' on Instance uuid 13fc31a7-732d-48be-a9d6-f36f39025ef2 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:09:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-813170300',display_name='tempest-AttachVolumeTestJSON-server-813170300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-813170300',id=51,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExrH5rBgSZd1xPM6h1WaG2PFBlI3ZT069LAqZjjDbaqMw2q2XZZ4lvzPHnMCTQd+GceCY91W3mbirNsIX5oPxgVKThyUS47XfALLaxlaq+iOqm1IoLp2Ps+wGusLocevw==',key_name='tempest-keypair-1551423877',keypairs=<?>,launch_index=0,launched_at=2023-11-08T19:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9a7b594e4b4ff3bb52470b1920e127',ramdisk_id='',reservation_id='r-sbf0u80w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-247912662',owner_user_name='tempest-AttachVolumeTestJSON-247912662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5686817e320e4e0bb7fd71fae1a375c4',uuid=13fc31a7-732d-48be-a9d6-f36f39025ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converting VIF {"id": "58b312da-b08c-4cff-aad9-9477f7154a00", "address": "fa:16:3e:c5:04:51", "network": {"id": "8b7c27b5-5d44-487a-8a78-a9c32eae23ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1650439144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9a7b594e4b4ff3bb52470b1920e127", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b312da-b0", "ovs_interfaceid": "58b312da-b08c-4cff-aad9-9477f7154a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG os_vif [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58b312da-b0, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=451601d7-bea4-405d-847f-27f5b30d2fdb) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:00 user nova-compute[74820]: INFO os_vif [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:04:51,bridge_name='br-int',has_traffic_filtering=True,id=58b312da-b08c-4cff-aad9-9477f7154a00,network=Network(8b7c27b5-5d44-487a-8a78-a9c32eae23ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b312da-b0')
Nov 08 19:13:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Deleting instance files /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2_del
Nov 08 19:13:00 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Deletion of /opt/stack/data/nova/instances/13fc31a7-732d-48be-a9d6-f36f39025ef2_del complete
Nov 08 19:13:00 user nova-compute[74820]: INFO nova.compute.manager [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 19:13:00 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 19:13:00 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 19:13:01 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:13:01 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Took 0.67 seconds to deallocate network for instance.
Nov 08 19:13:01 user nova-compute[74820]: DEBUG nova.compute.manager [req-f8cec039-6e53-4bec-b2dd-f3bc4262b518 req-3bb09c49-11fb-4a5e-97d8-dd56a111a4a0 service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-vif-deleted-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:01 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:13:01 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:13:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:01 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Deleted allocations for instance 13fc31a7-732d-48be-a9d6-f36f39025ef2
Nov 08 19:13:01 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-c9de1535-4958-46a2-a16f-20f6c72e52b6 tempest-AttachVolumeTestJSON-247912662 tempest-AttachVolumeTestJSON-247912662-project-member] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.849s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef8c170d-29ba-46ed-bc26-57745cdca7b0 req-24cdb095-77ec-430f-8b75-c719be73bdfc service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received event network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef8c170d-29ba-46ed-bc26-57745cdca7b0 req-24cdb095-77ec-430f-8b75-c719be73bdfc service nova] Acquiring lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef8c170d-29ba-46ed-bc26-57745cdca7b0 req-24cdb095-77ec-430f-8b75-c719be73bdfc service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:02 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-ef8c170d-29ba-46ed-bc26-57745cdca7b0 req-24cdb095-77ec-430f-8b75-c719be73bdfc service nova] Lock "13fc31a7-732d-48be-a9d6-f36f39025ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:02 user nova-compute[74820]: DEBUG nova.compute.manager [req-ef8c170d-29ba-46ed-bc26-57745cdca7b0 req-24cdb095-77ec-430f-8b75-c719be73bdfc service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] No waiting events found dispatching network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:13:02 user nova-compute[74820]: WARNING nova.compute.manager [req-ef8c170d-29ba-46ed-bc26-57745cdca7b0 req-24cdb095-77ec-430f-8b75-c719be73bdfc service nova] [instance: 13fc31a7-732d-48be-a9d6-f36f39025ef2] Received unexpected event network-vif-plugged-58b312da-b08c-4cff-aad9-9477f7154a00 for instance with vm_state deleted and task_state None.
Nov 08 19:13:05 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-changed-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Refreshing instance network info cache due to event network-changed-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] Acquiring lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] Acquired lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Refreshing network info cache for port 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:07 user nova-compute[74820]: INFO nova.compute.manager [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Terminating instance
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.compute.manager [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-57011e08-74c5-451a-a60f-2086168e5ed3 req-869b1cfb-02a7-49bb-9ad1-d7357e3779a7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-vif-unplugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-57011e08-74c5-451a-a60f-2086168e5ed3 req-869b1cfb-02a7-49bb-9ad1-d7357e3779a7 service nova] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-57011e08-74c5-451a-a60f-2086168e5ed3 req-869b1cfb-02a7-49bb-9ad1-d7357e3779a7 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-57011e08-74c5-451a-a60f-2086168e5ed3 req-869b1cfb-02a7-49bb-9ad1-d7357e3779a7 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-57011e08-74c5-451a-a60f-2086168e5ed3 req-869b1cfb-02a7-49bb-9ad1-d7357e3779a7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] No waiting events found dispatching network-vif-unplugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.compute.manager [req-57011e08-74c5-451a-a60f-2086168e5ed3 req-869b1cfb-02a7-49bb-9ad1-d7357e3779a7 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-vif-unplugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updated VIF entry in instance network info cache for port 4d3ede9d-2cda-46a2-80dd-caaa647ef5c9. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG nova.network.neutron [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [{"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:13:07 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-c768d9ed-086d-4d7e-b246-c08863486d6e req-c22f3c5e-ed77-49c4-aad7-938a37545c66 service nova] Releasing lock "refresh_cache-445de213-a08f-40f8-82be-e6f8e7570cac" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:13:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Instance destroyed successfully.
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.objects.instance [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lazy-loading 'resources' on Instance uuid 445de213-a08f-40f8-82be-e6f8e7570cac {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-873903775',display_name='tempest-TestStampPattern-server-873903775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-873903775',id=49,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Xz7HvuURkpQOW7B43HGiIZ6U9KG82L8l49gJ07K7KfnFUOaCugkIB6ZWljH9GuN9Bf7bDRJQjatX4jOFi1PJo04eQ40g/KkkxzLnHomEOqP8jhie2dM0OYzj4eed/uQ==',key_name='tempest-TestStampPattern-614517520',keypairs=<?>,launch_index=0,launched_at=2023-11-08T19:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8df34dac541940fdaee1e9eb0416c3f8',ramdisk_id='',reservation_id='r-pmn1s6qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-429227582',owner_user_name='tempest-TestStampPattern-429227582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:08:43Z,user_data=None,user_id='e8b0241004ce41c5a1a6c84f4b3465ac',uuid=445de213-a08f-40f8-82be-e6f8e7570cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converting VIF {"id": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "address": "fa:16:3e:78:1a:b5", "network": {"id": "8e267b99-c8ec-4b85-b7c0-335179530f37", "bridge": "br-int", "label": "tempest-TestStampPattern-483404952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df34dac541940fdaee1e9eb0416c3f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3ede9d-2c", "ovs_interfaceid": "4d3ede9d-2cda-46a2-80dd-caaa647ef5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG os_vif [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d3ede9d-2c, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=161fb763-45e6-4e29-a742-5a6bacf05a53) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:08 user nova-compute[74820]: INFO os_vif [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:1a:b5,bridge_name='br-int',has_traffic_filtering=True,id=4d3ede9d-2cda-46a2-80dd-caaa647ef5c9,network=Network(8e267b99-c8ec-4b85-b7c0-335179530f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3ede9d-2c')
Nov 08 19:13:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Deleting instance files /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac_del
Nov 08 19:13:08 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Deletion of /opt/stack/data/nova/instances/445de213-a08f-40f8-82be-e6f8e7570cac_del complete
Nov 08 19:13:08 user nova-compute[74820]: INFO nova.compute.manager [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 19:13:08 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:13:08 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Took 0.37 seconds to deallocate network for instance.
Nov 08 19:13:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:13:08 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:08 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Deleted allocations for instance 445de213-a08f-40f8-82be-e6f8e7570cac
Nov 08 19:13:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-031937cb-931d-4959-9167-84b031a0c6b0 tempest-TestStampPattern-429227582 tempest-TestStampPattern-429227582-project-member] Lock "445de213-a08f-40f8-82be-e6f8e7570cac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.507s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-1d8680b9-e0cc-4656-aa65-75c05b32e0bc req-dfe2c8a9-f34e-4c48-b5cb-72a23c75d01f service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-vif-deleted-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-1453e4bb-e15d-4e01-b418-6a5bffe2a64d req-0b08b419-19ed-41aa-ada7-538fb6fb2f87 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received event network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:13:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1453e4bb-e15d-4e01-b418-6a5bffe2a64d req-0b08b419-19ed-41aa-ada7-538fb6fb2f87 service nova] Acquiring lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1453e4bb-e15d-4e01-b418-6a5bffe2a64d req-0b08b419-19ed-41aa-ada7-538fb6fb2f87 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:09 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-1453e4bb-e15d-4e01-b418-6a5bffe2a64d req-0b08b419-19ed-41aa-ada7-538fb6fb2f87 service nova] Lock "445de213-a08f-40f8-82be-e6f8e7570cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:09 user nova-compute[74820]: DEBUG nova.compute.manager [req-1453e4bb-e15d-4e01-b418-6a5bffe2a64d req-0b08b419-19ed-41aa-ada7-538fb6fb2f87 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] No waiting events found dispatching network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:13:09 user nova-compute[74820]: WARNING nova.compute.manager [req-1453e4bb-e15d-4e01-b418-6a5bffe2a64d req-0b08b419-19ed-41aa-ada7-538fb6fb2f87 service nova] [instance: 445de213-a08f-40f8-82be-e6f8e7570cac] Received unexpected event network-vif-plugged-4d3ede9d-2cda-46a2-80dd-caaa647ef5c9 for instance with vm_state deleted and task_state None.
Nov 08 19:13:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:13:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:13:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:13:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:13:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:13:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:13:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 19:13:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:32 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:13:33 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:13:33 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=25.051280975341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:13:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:13:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 19:13:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 19:13:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 19:13:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:13:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:13:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:13:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:13:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:51 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:13:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:13:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:02 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:14:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:14:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:18 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:22 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:14:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:14:25 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:14:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:14:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 19:14:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:33 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:14:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:14:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:14:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:14:33 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:14:34 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:14:34 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:14:34 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.04946517944336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:14:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:14:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:14:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:14:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:15:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:15:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:20 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:22 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:22 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:15:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:15:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:15:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 19:15:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:15:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:15:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:15:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:15:34 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:15:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:15:35 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:15:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9149MB free_disk=25.038780212402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:15:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:15:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:15:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:16:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:16:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:21 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:16:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:25 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 19:16:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:30 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Starting instance... {{(pid=74820) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:34 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74820) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 19:16:34 user nova-compute[74820]: INFO nova.compute.claims [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Claim successful on node user
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Start building networks asynchronously for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Allocating IP information in the background. {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.network.neutron [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] allocate_for_instance() {{(pid=74820) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 19:16:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Start building block device mappings for instance. {{(pid=74820) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.policy [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb9e57c2bda1499ca6bc2c1715c90ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be1b1fefdc746ce82ef167aaa70242c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74820) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Start spawning the instance on the hypervisor. {{(pid=74820) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Creating instance directory {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 19:16:35 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Creating image(s)
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "/opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "/opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "/opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.169s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "28477c0901ec95487d4b808dd46694230e0454cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk 1073741824 {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf,backing_fmt=raw /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk 1073741824" returned: 0 in 0.051s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "28477c0901ec95487d4b808dd46694230e0454cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28477c0901ec95487d4b808dd46694230e0454cf --force-share --output=json" returned: 0 in 0.214s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk. size=1073741824 {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 19:16:35 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG nova.virt.disk.api [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Cannot resize image /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk to a smaller size. {{(pid=74820) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Created local disks {{(pid=74820) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Ensure instance console log exists: /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/console.log {{(pid=74820) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG nova.network.neutron [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Successfully created port: 7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:36 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Successfully updated port: 7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-changed-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.manager [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Refreshing instance network info cache due to event network-changed-7889b8e9-bede-4bca-a697-393307b53405. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Refreshing network info cache for port 7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:16:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:16:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9167MB free_disk=25.034896850585938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-7edd8ffc-a742-402a-a3bd-47a730dab9d5 req-572e7b52-53ef-4903-b5e8-f462fb43d520 service nova] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Building network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Instance cache missing network info. {{(pid=74820) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Instance network_info: |[{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74820) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Start _get_guest_xml network_info=[{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '71d031e1-e4c3-46c0-bfb5-c8044e0fbc93'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 19:16:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:16:37 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CPU controller missing on host. {{(pid=74820) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.host [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CPU controller found on host. {{(pid=74820) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74820) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T18:22:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T18:23:04Z,direct_url=<?>,disk_format='qcow2',id=71d031e1-e4c3-46c0-bfb5-c8044e0fbc93,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0a3edb428ba644fba5458edbce56cdf2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T18:23:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Flavor limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Image limits 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Flavor pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Image pref 0:0:0 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Got 1 possible topologies {{(pid=74820) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.hardware [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74820) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-80188927',display_name='tempest-SnapshotDataIntegrityTests-server-80188927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-80188927',id=52,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYepgDv/u5e7euxf5QAUlyeBXhY/55i4zQNCpfTL6PEKqXOaT5khUNOr1NMaSUAV4WUplqEarqfYbEEik/olgTIPrnm/BuKXbAljAuyyVIjlp3U/5rs4rDODr28ydqz/w==',key_name='tempest-keypair-1066508683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6be1b1fefdc746ce82ef167aaa70242c',ramdisk_id='',reservation_id='r-ito00dpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1794163812',owner_user_name='tempest-SnapshotDataIntegrityTests-1794163812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb9e57c2bda1499ca6bc2c1715c90ff1',uuid=972c8c4c-b50f-458a-842a-5293e62d3f08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74820) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Converting VIF {"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.objects.instance [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'pci_devices' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] End _get_guest_xml xml=<domain type="kvm">
Nov 08 19:16:37 user nova-compute[74820]:   <uuid>972c8c4c-b50f-458a-842a-5293e62d3f08</uuid>
Nov 08 19:16:37 user nova-compute[74820]:   <name>instance-00000034</name>
Nov 08 19:16:37 user nova-compute[74820]:   <memory>524288</memory>
Nov 08 19:16:37 user nova-compute[74820]:   <vcpu>1</vcpu>
Nov 08 19:16:37 user nova-compute[74820]:   <metadata>
Nov 08 19:16:37 user nova-compute[74820]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 19:16:37 user nova-compute[74820]:       <nova:package version="0.0.0"/>
Nov 08 19:16:37 user nova-compute[74820]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-80188927</nova:name>
Nov 08 19:16:37 user nova-compute[74820]:       <nova:creationTime>2023-11-08 19:16:37</nova:creationTime>
Nov 08 19:16:37 user nova-compute[74820]:       <nova:flavor name="m1.tiny">
Nov 08 19:16:37 user nova-compute[74820]:         <nova:memory>512</nova:memory>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:disk>1</nova:disk>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:swap>0</nova:swap>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:vcpus>1</nova:vcpus>
Nov 08 19:16:37 user nova-compute[74820]:       </nova:flavor>
Nov 08 19:16:37 user nova-compute[74820]:       <nova:owner>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:user uuid="cb9e57c2bda1499ca6bc2c1715c90ff1">tempest-SnapshotDataIntegrityTests-1794163812-project-member</nova:user>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:project uuid="6be1b1fefdc746ce82ef167aaa70242c">tempest-SnapshotDataIntegrityTests-1794163812</nova:project>
Nov 08 19:16:37 user nova-compute[74820]:       </nova:owner>
Nov 08 19:16:37 user nova-compute[74820]:       <nova:root type="image" uuid="71d031e1-e4c3-46c0-bfb5-c8044e0fbc93"/>
Nov 08 19:16:37 user nova-compute[74820]:       <nova:ports>
Nov 08 19:16:37 user nova-compute[74820]:         <nova:port uuid="7889b8e9-bede-4bca-a697-393307b53405">
Nov 08 19:16:37 user nova-compute[74820]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 19:16:37 user nova-compute[74820]:         </nova:port>
Nov 08 19:16:37 user nova-compute[74820]:       </nova:ports>
Nov 08 19:16:37 user nova-compute[74820]:     </nova:instance>
Nov 08 19:16:37 user nova-compute[74820]:   </metadata>
Nov 08 19:16:37 user nova-compute[74820]:   <sysinfo type="smbios">
Nov 08 19:16:37 user nova-compute[74820]:     <system>
Nov 08 19:16:37 user nova-compute[74820]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 19:16:37 user nova-compute[74820]:       <entry name="product">OpenStack Nova</entry>
Nov 08 19:16:37 user nova-compute[74820]:       <entry name="version">0.0.0</entry>
Nov 08 19:16:37 user nova-compute[74820]:       <entry name="serial">972c8c4c-b50f-458a-842a-5293e62d3f08</entry>
Nov 08 19:16:37 user nova-compute[74820]:       <entry name="uuid">972c8c4c-b50f-458a-842a-5293e62d3f08</entry>
Nov 08 19:16:37 user nova-compute[74820]:       <entry name="family">Virtual Machine</entry>
Nov 08 19:16:37 user nova-compute[74820]:     </system>
Nov 08 19:16:37 user nova-compute[74820]:   </sysinfo>
Nov 08 19:16:37 user nova-compute[74820]:   <os>
Nov 08 19:16:37 user nova-compute[74820]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 19:16:37 user nova-compute[74820]:     <boot dev="hd"/>
Nov 08 19:16:37 user nova-compute[74820]:     <smbios mode="sysinfo"/>
Nov 08 19:16:37 user nova-compute[74820]:   </os>
Nov 08 19:16:37 user nova-compute[74820]:   <features>
Nov 08 19:16:37 user nova-compute[74820]:     <acpi/>
Nov 08 19:16:37 user nova-compute[74820]:     <apic/>
Nov 08 19:16:37 user nova-compute[74820]:     <vmcoreinfo/>
Nov 08 19:16:37 user nova-compute[74820]:   </features>
Nov 08 19:16:37 user nova-compute[74820]:   <clock offset="utc">
Nov 08 19:16:37 user nova-compute[74820]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 19:16:37 user nova-compute[74820]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 19:16:37 user nova-compute[74820]:     <timer name="hpet" present="no"/>
Nov 08 19:16:37 user nova-compute[74820]:   </clock>
Nov 08 19:16:37 user nova-compute[74820]:   <cpu mode="custom" match="exact">
Nov 08 19:16:37 user nova-compute[74820]:     <model>Nehalem</model>
Nov 08 19:16:37 user nova-compute[74820]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 19:16:37 user nova-compute[74820]:   </cpu>
Nov 08 19:16:37 user nova-compute[74820]:   <devices>
Nov 08 19:16:37 user nova-compute[74820]:     <disk type="file" device="disk">
Nov 08 19:16:37 user nova-compute[74820]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 19:16:37 user nova-compute[74820]:       <source file="/opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk"/>
Nov 08 19:16:37 user nova-compute[74820]:       <target dev="vda" bus="virtio"/>
Nov 08 19:16:37 user nova-compute[74820]:     </disk>
Nov 08 19:16:37 user nova-compute[74820]:     <interface type="ethernet">
Nov 08 19:16:37 user nova-compute[74820]:       <mac address="fa:16:3e:f5:9d:89"/>
Nov 08 19:16:37 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:16:37 user nova-compute[74820]:       <mtu size="1442"/>
Nov 08 19:16:37 user nova-compute[74820]:       <target dev="tap7889b8e9-be"/>
Nov 08 19:16:37 user nova-compute[74820]:     </interface>
Nov 08 19:16:37 user nova-compute[74820]:     <serial type="pty">
Nov 08 19:16:37 user nova-compute[74820]:       <log file="/opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/console.log" append="off"/>
Nov 08 19:16:37 user nova-compute[74820]:     </serial>
Nov 08 19:16:37 user nova-compute[74820]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 19:16:37 user nova-compute[74820]:     <video>
Nov 08 19:16:37 user nova-compute[74820]:       <model type="virtio"/>
Nov 08 19:16:37 user nova-compute[74820]:     </video>
Nov 08 19:16:37 user nova-compute[74820]:     <rng model="virtio">
Nov 08 19:16:37 user nova-compute[74820]:       <backend model="random">/dev/urandom</backend>
Nov 08 19:16:37 user nova-compute[74820]:     </rng>
Nov 08 19:16:37 user nova-compute[74820]:     <controller type="usb" index="0" model="none"/>
Nov 08 19:16:37 user nova-compute[74820]:     <memballoon model="virtio">
Nov 08 19:16:37 user nova-compute[74820]:       <stats period="10"/>
Nov 08 19:16:37 user nova-compute[74820]:     </memballoon>
Nov 08 19:16:37 user nova-compute[74820]:   </devices>
Nov 08 19:16:37 user nova-compute[74820]: </domain>
Nov 08 19:16:37 user nova-compute[74820]:  {{(pid=74820) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-80188927',display_name='tempest-SnapshotDataIntegrityTests-server-80188927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-80188927',id=52,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYepgDv/u5e7euxf5QAUlyeBXhY/55i4zQNCpfTL6PEKqXOaT5khUNOr1NMaSUAV4WUplqEarqfYbEEik/olgTIPrnm/BuKXbAljAuyyVIjlp3U/5rs4rDODr28ydqz/w==',key_name='tempest-keypair-1066508683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6be1b1fefdc746ce82ef167aaa70242c',ramdisk_id='',reservation_id='r-ito00dpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1794163812',owner_user_name='tempest-SnapshotDataIntegrityTests-1794163812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T19:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb9e57c2bda1499ca6bc2c1715c90ff1',uuid=972c8c4c-b50f-458a-842a-5293e62d3f08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Converting VIF {"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG os_vif [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be') {{(pid=74820) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd92a44c9-5bfc-560f-a639-0685ab2c4177', '_type': 'linux-noop'}}, row=False) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7889b8e9-be, may_exist=True, interface_attrs={}) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7889b8e9-be, col_values=(('qos', UUID('0cb33183-950d-45a6-b1f8-b7d1ef7900c6')),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7889b8e9-be, col_values=(('external_ids', {'iface-id': '7889b8e9-bede-4bca-a697-393307b53405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:9d:89', 'vm-uuid': '972c8c4c-b50f-458a-842a-5293e62d3f08'}),), if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:37 user nova-compute[74820]: INFO os_vif [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be')
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:16:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No VIF found with MAC fa:16:3e:f5:9d:89, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-818face2-4f04-4929-8e51-c015989e275c req-cbcbd393-701e-44ec-bcab-862123e35f72 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-818face2-4f04-4929-8e51-c015989e275c req-cbcbd393-701e-44ec-bcab-862123e35f72 service nova] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-818face2-4f04-4929-8e51-c015989e275c req-cbcbd393-701e-44ec-bcab-862123e35f72 service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-818face2-4f04-4929-8e51-c015989e275c req-cbcbd393-701e-44ec-bcab-862123e35f72 service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG nova.compute.manager [req-818face2-4f04-4929-8e51-c015989e275c req-cbcbd393-701e-44ec-bcab-862123e35f72 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] No waiting events found dispatching network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:16:39 user nova-compute[74820]: WARNING nova.compute.manager [req-818face2-4f04-4929-8e51-c015989e275c req-cbcbd393-701e-44ec-bcab-862123e35f72 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received unexpected event network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 for instance with vm_state building and task_state spawning.
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:39 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Instance event wait completed in 0 seconds for  {{(pid=74820) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Guest created on hypervisor {{(pid=74820) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 19:16:41 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Instance spawned successfully.
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Found default for hw_cdrom_bus of ide {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Found default for hw_disk_bus of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Found default for hw_input_bus of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Found default for hw_pointer_model of None {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Found default for hw_video_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Found default for hw_vif_model of virtio {{(pid=74820) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 19:16:41 user nova-compute[74820]: INFO nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Checking state {{(pid=74820) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 19:16:41 user nova-compute[74820]: INFO nova.compute.manager [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Took 6.67 seconds to build instance.
Nov 08 19:16:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-13ff9e3a-a2bd-4708-8faa-71b969ac904f tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.769s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-37cdb447-77d2-47f7-bd71-4796a8335de5 req-35f20808-915e-40fc-b2bc-4e0d40ee8cea service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-37cdb447-77d2-47f7-bd71-4796a8335de5 req-35f20808-915e-40fc-b2bc-4e0d40ee8cea service nova] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-37cdb447-77d2-47f7-bd71-4796a8335de5 req-35f20808-915e-40fc-b2bc-4e0d40ee8cea service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-37cdb447-77d2-47f7-bd71-4796a8335de5 req-35f20808-915e-40fc-b2bc-4e0d40ee8cea service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:16:41 user nova-compute[74820]: DEBUG nova.compute.manager [req-37cdb447-77d2-47f7-bd71-4796a8335de5 req-35f20808-915e-40fc-b2bc-4e0d40ee8cea service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] No waiting events found dispatching network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:16:41 user nova-compute[74820]: WARNING nova.compute.manager [req-37cdb447-77d2-47f7-bd71-4796a8335de5 req-35f20808-915e-40fc-b2bc-4e0d40ee8cea service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received unexpected event network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 for instance with vm_state active and task_state None.
Nov 08 19:16:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:16:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:09 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:17:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:23 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:23 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:17:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:25 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:17:29 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:17:30 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:17:30 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:17:30 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:17:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:33 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:17:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:17:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:17:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.00582504272461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:17:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:17:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:17:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:18:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:18:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:18:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:18:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:18:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:24 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:24 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:18:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-changed-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:18:25 user nova-compute[74820]: DEBUG nova.compute.manager [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Refreshing instance network info cache due to event network-changed-7889b8e9-bede-4bca-a697-393307b53405. {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 19:18:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:18:25 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:18:25 user nova-compute[74820]: DEBUG nova.network.neutron [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Refreshing network info cache for port 7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 19:18:26 user nova-compute[74820]: DEBUG nova.network.neutron [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated VIF entry in instance network info cache for port 7889b8e9-bede-4bca-a697-393307b53405. {{(pid=74820) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 19:18:26 user nova-compute[74820]: DEBUG nova.network.neutron [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:18:26 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-869afd89-3c7b-44b5-b74e-bde40b2829cd req-0656eaf7-94ee-408a-b62d-151f7158aff4 service nova] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:18:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:18:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:18:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:18:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:18:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:18:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:18:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:18:33 user nova-compute[74820]: INFO nova.compute.manager [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attaching volume fa11c664-df78-4a20-b701-4e8a8336f104 to /dev/vdb
Nov 08 19:18:33 user nova-compute[74820]: DEBUG os_brick.utils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a35e656-e7a7-4dfc-87e6-2a467da149be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5467b5e-f6e4-46ad-a40e-93de671f1274]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0899d3a-3621-4dfc-81a7-f6543a9e2675]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba447bae-dccb-4988-847a-7d0d11e52e47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:18:33 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:18:33 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5407377-ebc0-4e55-94b9-cce90ad14ee1]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG os_brick.utils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:18:33 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating existing volume attachment record: 73afc86c-714c-44b3-9873-3d602ef9bbbd {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:18:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:18:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:18:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:18:37 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:18:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:18:38 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:18:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=25.004985809326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:18:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:18:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:18:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:18:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 19:18:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 19:18:47 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:47 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 19:18:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEbrToq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:18:55 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:18:55 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:18:55 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985ec78-3a3c-461d-9525-698f301070f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:18:55 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52756ddf-be27-4a4b-baa4-18fcf342699b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104] added
Nov 08 19:18:55 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b938f7-bf2f-4fd0-bc11-584369f9ad53]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620254f-5895-4385-bc15-9c7c4b1f805a]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEbrToq {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szEbrToq" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc2f00-6cbe-4719-b1cc-cafdc1000651]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szEbrToq'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2013cf-b97e-4515-8138-910fcb70df08]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab3791-8d6a-4812-8960-be490b609cd0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:18:55 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:18:55 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:18:55 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:18:55 user nova-compute[74820]: 
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d503c-a53d-4892-ac27-4382dad4bf07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260]
Nov 08 19:18:55 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260] successful.
Nov 08 19:18:55 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f21d7-788b-4bd1-a479-334a8bad62e9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d010b8-c6ca-4d2f-92e5-666ce864ecb6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 (non-flash)
Nov 08 19:18:55 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 (non-flash)
Nov 08 19:18:55 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b6142a-ef42-417b-a6fa-39c8010c39cd]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:18:55 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEbrToq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23730343539353666', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730343539353666', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG nova.objects.instance [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:18:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:18:56 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:18:56 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:18:56 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:18:56 user nova-compute[74820]:   <serial>fa11c664-df78-4a20-b701-4e8a8336f104</serial>
Nov 08 19:18:56 user nova-compute[74820]: </disk>
Nov 08 19:18:56 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:18:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:18:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:18:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No VIF found with MAC fa:16:3e:f5:9d:89, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:18:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-74e13e24-12cd-46cb-bf7c-ba8e0c01684e tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.909s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:18:57 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:18:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:18:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:04 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:14 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:24 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:25 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:25 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:25 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:19:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:29 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:19:31 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:19:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:19:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:19:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:19:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:19:36 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:19:36 user nova-compute[74820]: INFO nova.compute.manager [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Detaching volume fa11c664-df78-4a20-b701-4e8a8336f104
Nov 08 19:19:36 user nova-compute[74820]: INFO nova.virt.block_device [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attempting to driver detach volume fa11c664-df78-4a20-b701-4e8a8336f104 from mountpoint /dev/vdb
Nov 08 19:19:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Attempting to detach device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:19:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:19:36 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:19:36 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:19:36 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:19:36 user nova-compute[74820]:   <serial>fa11c664-df78-4a20-b701-4e8a8336f104</serial>
Nov 08 19:19:36 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:19:36 user nova-compute[74820]: </disk>
Nov 08 19:19:36 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:19:36 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config.
Nov 08 19:19:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:19:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:19:36 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:19:36 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:19:36 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:19:36 user nova-compute[74820]:   <serial>fa11c664-df78-4a20-b701-4e8a8336f104</serial>
Nov 08 19:19:36 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:19:36 user nova-compute[74820]: </disk>
Nov 08 19:19:36 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:19:36 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:19:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:19:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:19:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:19:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:19:38 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:19:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:39 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:19:39 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=25.003772735595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:19:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:19:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:19:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:19:56 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 is timed out.
Nov 08 19:19:56 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config.
Nov 08 19:19:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szEbrToq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:19:56 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee58cf-59cd-408a-8cad-db199838ac9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:19:56 user nova-compute[74820]: No targets found.
Nov 08 19:19:56 user nova-compute[74820]: iSNS:
Nov 08 19:19:56 user nova-compute[74820]: No targets found.
Nov 08 19:19:56 user nova-compute[74820]: STATIC:
Nov 08 19:19:56 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104
Nov 08 19:19:56 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:19:56 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:19:56 user nova-compute[74820]: FIRMWARE:
Nov 08 19:19:56 user nova-compute[74820]: No targets found.
Nov 08 19:19:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:19:56 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:19:56 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5585054-699a-43e9-bff3-b2a84cdb012a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f961eb5-db0f-4d29-a414-7a8f344dfaa7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 (non-flash)
Nov 08 19:19:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 (non-flash)
Nov 08 19:19:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e281da050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2baee-b4c3-4bb1-874d-5d45e965e6ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c97c60-cf05-4d24-a956-5892dda7f8ce]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e7efc4-d641-4b3e-bea7-f4ace81abf21]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b4d43-df05-417b-8435-d88740ec24fd]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[444cd0fb-c5f4-4787-968d-9daf6e2588b8]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe9fd0a-5f34-4030-85ab-34e3d9ecfeb5]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260]
Nov 08 19:19:56 user nova-compute[74820]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104, portal: 172.16.0.220,3260] successful.
Nov 08 19:19:56 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa11c664-df78-4a20-b701-4e8a8336f104 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc994cb5-8904-4f1d-b4f3-7f20849c80bd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== disconnect_volume: return (275ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:19:56 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:19:57 user nova-compute[74820]: DEBUG nova.objects.instance [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:19:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-9a2eb51e-1956-41e9-8e70-a7f5ff943466 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:19:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:20:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:20:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:20:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:20:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:20:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:26 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:26 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:20:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:20:32 user nova-compute[74820]: INFO nova.compute.manager [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attaching volume 7ad781b2-c5ab-4b45-aec0-170175c0430f to /dev/vdb
Nov 08 19:20:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d544c-b47a-467c-9f19-a59a302c88cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ec80e8-4a4a-4fd7-94dc-705b4b34b4ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a9fb8-7b28-4dbd-aef2-ed13888a9974]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8a491a-cf4d-4b65-902a-0a4621c229cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:20:32 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35947e-2ea1-455c-8246-27d7a574124c]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG os_brick.utils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating existing volume attachment record: a01708d6-6829-4e70-b5c0-e059865b59ef {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:20:32 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:20:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:20:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:20:33 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:34 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:37 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:20:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:20:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:20:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:20:40 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:20:40 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:41 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:20:41 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=24.995174407958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:20:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:20:42 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:47 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:52 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qflohuUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:20:53 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:20:53 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:20:53 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff60089-a06b-4f33-a1b5-386d1473c770]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:20:53 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3b513-5e43-465d-ac59-addbb48eaaef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f] added
Nov 08 19:20:53 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea11316-efa9-4fbe-8bd2-9b11ffc8313d]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68cd35d-9fce-4826-9d49-af86cae2f741]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qflohuUm {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qflohuUm" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5a3994-cc13-4acb-8f98-40e9b90d0073]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qflohuUm'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[28075fc8-9c30-4c3c-8ec6-6795b8b4619f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88eea6-54ac-4818-aca2-518a78ea4395]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:20:53 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:20:53 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:20:53 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:20:53 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:20:53 user nova-compute[74820]: 
Nov 08 19:20:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d892cd31-bd0f-4a3e-b41b-fd157041d277]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260]
Nov 08 19:20:54 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260] successful.
Nov 08 19:20:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e137fe-8480-463f-831f-49156a76c728]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faefc94-0c21-4578-a1a0-f0878102f266]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f (non-flash)
Nov 08 19:20:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f (non-flash)
Nov 08 19:20:54 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a53200-6a14-433c-bcfb-59243b35b08a]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:20:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qflohuUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23461376562616266', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461376562616266', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:20:55 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:20:55 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:20:55 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:20:55 user nova-compute[74820]:   <serial>7ad781b2-c5ab-4b45-aec0-170175c0430f</serial>
Nov 08 19:20:55 user nova-compute[74820]: </disk>
Nov 08 19:20:55 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No VIF found with MAC fa:16:3e:f5:9d:89, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:20:55 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2f9bd438-e2c1-46ac-98ad-bf1eb4f10350 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.386s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:20:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:20:57 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:20:57 user nova-compute[74820]: INFO nova.compute.manager [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Detaching volume 7ad781b2-c5ab-4b45-aec0-170175c0430f
Nov 08 19:20:57 user nova-compute[74820]: INFO nova.virt.block_device [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attempting to driver detach volume 7ad781b2-c5ab-4b45-aec0-170175c0430f from mountpoint /dev/vdb
Nov 08 19:20:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Attempting to detach device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:20:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:20:57 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:20:57 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:20:57 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:20:57 user nova-compute[74820]:   <serial>7ad781b2-c5ab-4b45-aec0-170175c0430f</serial>
Nov 08 19:20:57 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:20:57 user nova-compute[74820]: </disk>
Nov 08 19:20:57 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:20:57 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config.
Nov 08 19:20:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:20:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:20:57 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:20:57 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:20:57 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:20:57 user nova-compute[74820]:   <serial>7ad781b2-c5ab-4b45-aec0-170175c0430f</serial>
Nov 08 19:20:57 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:20:57 user nova-compute[74820]: </disk>
Nov 08 19:20:57 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:20:57 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:20:57 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:20:59 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:02 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:07 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:12 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:17 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 is timed out.
Nov 08 19:21:17 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config.
Nov 08 19:21:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qflohuUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:21:17 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:21:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[47266fdc-6a72-4b4b-ac5e-f57692622a04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:21:17 user nova-compute[74820]: No targets found.
Nov 08 19:21:17 user nova-compute[74820]: iSNS:
Nov 08 19:21:17 user nova-compute[74820]: No targets found.
Nov 08 19:21:17 user nova-compute[74820]: STATIC:
Nov 08 19:21:17 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f
Nov 08 19:21:17 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:21:17 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:21:17 user nova-compute[74820]: FIRMWARE:
Nov 08 19:21:17 user nova-compute[74820]: No targets found.
Nov 08 19:21:17 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:21:17 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:21:17 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:17 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a78a6-ed3c-49bc-9b35-1a123a2285da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31d449-b10a-423c-b7ca-68e9086ae5ef]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f (non-flash)
Nov 08 19:21:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f (non-flash)
Nov 08 19:21:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4c48c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b72b6-c112-4f19-a8f5-2d076a90bcc0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3e72fc-9bc1-4596-813e-cbb264aae1a7]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb96c2cc-1bca-4975-940a-8f4ba40f0b7f]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.116s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffbf490-0d66-403a-9e88-c400ad8bbf7a]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[3220a92b-8ac1-4221-85b8-44eba3e79998]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ef011-104f-4e19-9ccf-833bf91db0f9]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260]
Nov 08 19:21:18 user nova-compute[74820]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f, portal: 172.16.0.220,3260] successful.
Nov 08 19:21:18 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad781b2-c5ab-4b45-aec0-170175c0430f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae929713-5101-4b24-851d-35d0b4f82d87]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== disconnect_volume: return (386ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:21:18 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:21:19 user nova-compute[74820]: DEBUG nova.objects.instance [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:21:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-95f28739-66f5-490b-8877-08789b2e39c1 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:21:22 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:21:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:27 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:21:27 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:21:32 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:21:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:21:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:21:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:21:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:21:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:21:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:21:42 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:21:42 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:21:42 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:21:43 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=24.994224548339844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:21:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:21:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:21:53 user nova-compute[74820]: INFO nova.compute.manager [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attaching volume 2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 to /dev/vdb
Nov 08 19:21:53 user nova-compute[74820]: DEBUG os_brick.utils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f62f6-80c8-44ee-b731-01c71484aecd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e684f6-bf97-4c85-a7b6-e6fbcd7a6707]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:53 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ef90f2-08ac-48fc-ba59-d0adeee6480f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5ebb39-2bfc-49fa-8ca1-3bfec4a6eed3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:21:54 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:21:54 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301837d-bb93-4d6b-9511-015a1cd84a5b]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG os_brick.utils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating existing volume attachment record: cc455f64-24bc-416f-a028-884802371f92 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:21:54 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:21:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:22:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPasOioH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:22:15 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:22:15 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:22:15 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[472cbc7b-e21c-4ceb-87e6-6c0d5c7c2fba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:22:15 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c2430a-984b-49fa-99b8-e7f252241d35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9] added
Nov 08 19:22:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9da1d2-56ce-48f4-af9f-f6831a1e88ae]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb65bbbe-5e46-4790-910d-9c9e05c1e8b7]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPasOioH {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPasOioH" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f0abde-78f7-42dc-ab70-3e842a2a3718]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZPasOioH'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e8ad5c-51f7-4070-9d1a-94483567377c]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[149bc7ed-95f5-4c56-8a01-19ae782c04d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:22:15 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:22:15 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:22:15 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:22:15 user nova-compute[74820]: 
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b29a68-d7f7-47ca-a706-ecd77f108e75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260]
Nov 08 19:22:15 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260] successful.
Nov 08 19:22:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f8909c-9709-4e85-abdc-266ea75a1dcd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[df477cb0-f185-4101-a9e7-e32cb45b7bba]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 (non-flash)
Nov 08 19:22:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 (non-flash)
Nov 08 19:22:15 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[87394530-9c39-481a-942f-7edf510d5330]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:15 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPasOioH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23334373638316337', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334373638316337', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:22:16 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:22:16 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:22:16 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:22:16 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:22:16 user nova-compute[74820]:   <serial>2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9</serial>
Nov 08 19:22:16 user nova-compute[74820]: </disk>
Nov 08 19:22:16 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:22:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:22:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:22:17 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No VIF found with MAC fa:16:3e:f5:9d:89, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:22:17 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2ef3a759-c9d5-4dcb-8fa1-bfe6f4021c5b tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.358s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:22:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:22:19 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:22:19 user nova-compute[74820]: INFO nova.compute.manager [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Detaching volume 2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9
Nov 08 19:22:19 user nova-compute[74820]: INFO nova.virt.block_device [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attempting to driver detach volume 2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 from mountpoint /dev/vdb
Nov 08 19:22:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Attempting to detach device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:22:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:22:19 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:22:19 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:22:19 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:22:19 user nova-compute[74820]:   <serial>2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9</serial>
Nov 08 19:22:19 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:22:19 user nova-compute[74820]: </disk>
Nov 08 19:22:19 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:22:19 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config.
Nov 08 19:22:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:22:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:22:19 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:22:19 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:22:19 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:22:19 user nova-compute[74820]:   <serial>2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9</serial>
Nov 08 19:22:19 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:22:19 user nova-compute[74820]: </disk>
Nov 08 19:22:19 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:22:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:19 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:22:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:29 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:29 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:22:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:22:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:22:33 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:39 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 is timed out.
Nov 08 19:22:39 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config.
Nov 08 19:22:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPasOioH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:22:39 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6cfdb-6864-44de-8fd9-2581006cf649]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:22:39 user nova-compute[74820]: No targets found.
Nov 08 19:22:39 user nova-compute[74820]: iSNS:
Nov 08 19:22:39 user nova-compute[74820]: No targets found.
Nov 08 19:22:39 user nova-compute[74820]: STATIC:
Nov 08 19:22:39 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9
Nov 08 19:22:39 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:22:39 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:22:39 user nova-compute[74820]: FIRMWARE:
Nov 08 19:22:39 user nova-compute[74820]: No targets found.
Nov 08 19:22:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:22:39 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:22:39 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b02dd-6773-4cab-8b3b-2c530a6a34c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d1c0ac-c613-404b-9a07-91365ac8c3c6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 (non-flash)
Nov 08 19:22:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 (non-flash)
Nov 08 19:22:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e28269630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cde072-eb9e-4a04-adc1-04b163cc480b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b13ae-25b8-4a14-ae1b-aae7d77df4bc]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a3311d-b6ab-40f3-bbc9-3697f280febd]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6c09f-a372-4710-8c43-45cb130b5f12]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5d2f5-ae5f-4db2-810a-caec62905c96]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e7dbf2-4049-4bb0-b6f4-d35568092615]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260]
Nov 08 19:22:39 user nova-compute[74820]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9, portal: 172.16.0.220,3260] successful.
Nov 08 19:22:39 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8e7a6d-304b-4e0a-9768-ff8c3b8944f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ce72b0-77f9-4eed-a61b-0300520dee80]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== disconnect_volume: return (284ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:22:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:22:40 user nova-compute[74820]: DEBUG nova.objects.instance [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:22:40 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-48972a2c-52f4-422b-b387-f0bfac061e34 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:22:43 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:22:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:22:44 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=24.993179321289062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:22:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:22:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:22:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:22:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:23:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:23:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:23:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:23:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:23:15 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:23:15 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:23:16 user nova-compute[74820]: INFO nova.compute.manager [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attaching volume cc617ad1-9e5b-499a-960c-4e01d9fd256d to /dev/vdb
Nov 08 19:23:16 user nova-compute[74820]: DEBUG os_brick.utils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8065adb4-c2f1-447a-8e58-91c6e3b9222c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d03f82c349ae\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[982aa05f-44b7-4659-9214-cebe326ed7a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bca8b3-f225-44ab-9dfd-00ed80cbf21e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba2c18-9172-4e08-b49b-3758a11e891e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Running cmd (subprocess): nvme version {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] nvme not present on system {{(pid=74820) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 19:23:16 user nova-compute[74820]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 19:23:16 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6cb29-dec6-4849-9fb4-9e40099f9807]: (4, '') {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74820) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.lightos [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] LIGHTOS: no hostnqn found. {{(pid=74820) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG os_brick.utils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d03f82c349ae', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:23:16 user nova-compute[74820]: DEBUG nova.virt.block_device [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating existing volume attachment record: 4ad867dd-7b1f-4247-978c-55ae9a33b2f6 {{(pid=74820) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 19:23:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:23:19 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:27 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:31 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:31 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:23:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:23:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:23:34 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:23:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Calling os-brick to attach iSCSI Volume {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgKZHOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:23:37 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:23:37 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:23:37 user nova-compute[74820]: INFO os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc4fbe5-1bf3-420c-8f89-3ca242032688]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 19:23:37 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --interface default --op new {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc3035-b09a-410e-ab22-c72fa1de4191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d] added\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d] added
Nov 08 19:23:37 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c64caf5-0fa0-42a8-b746-9bc7e18081a9]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:37 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[52961d78-6a7c-4953-a8d2-232cb82c59d6]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgKZHOrA {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgKZHOrA" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e329f-1a85-4b79-87ea-71555608a747]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgKZHOrA'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[483d98ef-e1e4-4f4e-bdf8-2533b8811d72]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47313fb-cd23-4ed4-a0bc-8d91b80022d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:23:38 user nova-compute[74820]:  {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 19:23:38 user nova-compute[74820]:  {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:23:38 user nova-compute[74820]: WARNING os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 19:23:38 user nova-compute[74820]: 
Nov 08 19:23:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --login {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3295ed4-1558-4c85-b799-4500df572167]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260]
Nov 08 19:23:38 user nova-compute[74820]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260] successful.
Nov 08 19:23:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9b00df-36fd-4edb-8eb3-b107cc4fa112]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd45908-9635-43ce-988c-0abd181aa174]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d (non-flash)
Nov 08 19:23:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d (non-flash)
Nov 08 19:23:38 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to 172.16.0.220:3260 {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74820) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74820) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab55a6b-519a-499c-b1b8-c297a9bc5338]: (4, ('- - 0', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74820) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 19:23:38 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgKZHOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74820) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26439633337646435', 'path': '/dev/sdb'} {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439633337646435', 'path': '/dev/sdb'} {{(pid=74820) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG nova.objects.instance [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 19:23:39 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:23:39 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:23:39 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:23:39 user nova-compute[74820]:   <serial>cc617ad1-9e5b-499a-960c-4e01d9fd256d</serial>
Nov 08 19:23:39 user nova-compute[74820]: </disk>
Nov 08 19:23:39 user nova-compute[74820]:  {{(pid=74820) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74820) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] No VIF found with MAC fa:16:3e:f5:9d:89, not building metadata {{(pid=74820) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 19:23:39 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-2b9b282f-b7cc-4670-84f2-1a5c63edb7f4 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.364s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:23:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:23:41 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:23:41 user nova-compute[74820]: INFO nova.compute.manager [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Detaching volume cc617ad1-9e5b-499a-960c-4e01d9fd256d
Nov 08 19:23:41 user nova-compute[74820]: INFO nova.virt.block_device [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Attempting to driver detach volume cc617ad1-9e5b-499a-960c-4e01d9fd256d from mountpoint /dev/vdb
Nov 08 19:23:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Attempting to detach device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config. {{(pid=74820) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 19:23:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:23:41 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:23:41 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:23:41 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:23:41 user nova-compute[74820]:   <serial>cc617ad1-9e5b-499a-960c-4e01d9fd256d</serial>
Nov 08 19:23:41 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:23:41 user nova-compute[74820]: </disk>
Nov 08 19:23:41 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:23:41 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the persistent domain config.
Nov 08 19:23:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config. {{(pid=74820) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 19:23:41 user nova-compute[74820]: DEBUG nova.virt.libvirt.guest [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 19:23:41 user nova-compute[74820]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 19:23:41 user nova-compute[74820]:   <source dev="/dev/sdb"/>
Nov 08 19:23:41 user nova-compute[74820]:   <target dev="vdb" bus="virtio"/>
Nov 08 19:23:41 user nova-compute[74820]:   <serial>cc617ad1-9e5b-499a-960c-4e01d9fd256d</serial>
Nov 08 19:23:41 user nova-compute[74820]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 19:23:41 user nova-compute[74820]: </disk>
Nov 08 19:23:41 user nova-compute[74820]:  {{(pid=74820) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 19:23:42 user nova-compute[74820]: DEBUG nova.virt.libvirt.driver [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 19:23:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:23:44 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:23:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:23:45 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=24.992218017578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing inventories for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating ProviderTree inventory for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Updating inventory in ProviderTree for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing aggregate associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, aggregates: None {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Refreshing trait associations for resource provider b6dd5339-b9ae-45ca-86de-93315b7f0863, traits: COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74820) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:23:45 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:23:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:23:53 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 19:23:53 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] There are 0 instances to clean {{(pid=74820) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 19:23:54 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:23:54 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74820) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 19:23:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:01 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:02 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 is timed out.
Nov 08 19:24:02 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully detached device vdb from instance 972c8c4c-b50f-458a-842a-5293e62d3f08 from the live domain config.
Nov 08 19:24:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] calling os-brick to detach iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3e402ac130>, {'target_iqn': 'iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgKZHOrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 19:24:02 user nova-compute[74820]: WARNING os_brick.initiator.connectors.base [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[d157b338-5515-4fa8-8cfd-1726d903dee1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 19:24:02 user nova-compute[74820]: No targets found.
Nov 08 19:24:02 user nova-compute[74820]: iSNS:
Nov 08 19:24:02 user nova-compute[74820]: No targets found.
Nov 08 19:24:02 user nova-compute[74820]: STATIC:
Nov 08 19:24:02 user nova-compute[74820]: Target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d
Nov 08 19:24:02 user nova-compute[74820]:         Portal: 172.16.0.220:3260,-1
Nov 08 19:24:02 user nova-compute[74820]:                 Iface Name: default
Nov 08 19:24:02 user nova-compute[74820]: FIRMWARE:
Nov 08 19:24:02 user nova-compute[74820]: No targets found.
Nov 08 19:24:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 19:24:02 user nova-compute[74820]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 19:24:02 user nova-compute[74820]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74820) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d', 0)] {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[be774cca-58cb-4636-9cc2-f96d05bf8c17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f948c-1fd3-4152-942b-3786ec977f1d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d (non-flash)\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d (non-flash)
Nov 08 19:24:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d (non-flash)
Nov 08 19:24:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3e4030cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d'): ({'sdb'}, set())}) {{(pid=74820) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Removing single pathed devices sdb {{(pid=74820) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bd12e-dc6a-43da-b353-304052b30e47]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[5832eac8-f10d-4fb4-bd1d-88e5bb407ece]: (4, ('ok\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Flushing IO for device /dev/sdb {{(pid=74820) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[0398f8e1-3ce0-4fff-93b2-f2064a41a658]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74820) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b6260f-2e58-4327-a998-44cd9806a7d7]: (4, ('1', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.linuxscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] SCSI volumes sdb have been removed. {{(pid=74820) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d')] {{(pid=74820) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff74ec-9489-4021-87b8-9fa43878c058]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --logout {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c9de4-3042-4823-81cc-094eb96cfeda]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260]
Nov 08 19:24:02 user nova-compute[74820]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d, portal: 172.16.0.220,3260] successful.
Nov 08 19:24:02 user nova-compute[74820]:  stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op delete {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc617ad1-9e5b-499a-960c-4e01d9fd256d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b154ffa-c939-4586-a6dd-d262e35db02b]: (4, ('', '')) {{(pid=86592) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74820) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.base [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG os_brick.initiator.connectors.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] <== disconnect_volume: return (277ms) None {{(pid=74820) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 19:24:02 user nova-compute[74820]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Disconnected iSCSI Volume {{(pid=74820) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 19:24:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:03 user nova-compute[74820]: DEBUG nova.objects.instance [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'flavor' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:24:03 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-b457416a-c116-42be-b1e1-16026119c5f6 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:24:04 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:06 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:06 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Triggering sync for uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 19:24:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:24:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:24:06 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:24:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:28 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:31 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:32 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:24:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:36 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:36 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:24:36 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:24:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:24:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:24:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:24:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:24:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:24:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:24:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:24:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:24:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=24.991416931152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:24:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:24:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:53 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:24:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:24:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:24:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:24:58 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:03 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:08 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:13 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:25:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:25:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:25:18 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:23 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:28 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:31 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:32 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:33 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:33 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:33 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:25:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:25:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquired lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Forcefully refreshing network info cache for instance {{(pid=74820) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG nova.objects.instance [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lazy-loading 'info_cache' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG nova.network.neutron [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [{"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Releasing lock "refresh_cache-972c8c4c-b50f-458a-842a-5293e62d3f08" {{(pid=74820) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updated the network info_cache for instance {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 19:25:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:40 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:43 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:25:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:25:46 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG oslo_concurrency.processutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74820) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 19:25:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:25:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9044MB free_disk=24.990428924560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Instance 972c8c4c-b50f-458a-842a-5293e62d3f08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74820) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:25:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:50 user nova-compute[74820]: INFO nova.compute.manager [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Terminating instance
Nov 08 19:25:50 user nova-compute[74820]: DEBUG nova.compute.manager [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Start destroying the instance on the hypervisor. {{(pid=74820) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:50 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-b1b4ea5d-8580-4266-a6f3-5d4a42fea622 req-8204509e-1212-4d6e-a17f-e465e6706932 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-vif-unplugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b1b4ea5d-8580-4266-a6f3-5d4a42fea622 req-8204509e-1212-4d6e-a17f-e465e6706932 service nova] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b1b4ea5d-8580-4266-a6f3-5d4a42fea622 req-8204509e-1212-4d6e-a17f-e465e6706932 service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-b1b4ea5d-8580-4266-a6f3-5d4a42fea622 req-8204509e-1212-4d6e-a17f-e465e6706932 service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-b1b4ea5d-8580-4266-a6f3-5d4a42fea622 req-8204509e-1212-4d6e-a17f-e465e6706932 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] No waiting events found dispatching network-vif-unplugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.compute.manager [req-b1b4ea5d-8580-4266-a6f3-5d4a42fea622 req-8204509e-1212-4d6e-a17f-e465e6706932 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-vif-unplugged-7889b8e9-bede-4bca-a697-393307b53405 for instance with task_state deleting. {{(pid=74820) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: INFO nova.virt.libvirt.driver [-] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Instance destroyed successfully.
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.objects.instance [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lazy-loading 'resources' on Instance uuid 972c8c4c-b50f-458a-842a-5293e62d3f08 {{(pid=74820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.virt.libvirt.vif [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T19:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-80188927',display_name='tempest-SnapshotDataIntegrityTests-server-80188927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-80188927',id=52,image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYepgDv/u5e7euxf5QAUlyeBXhY/55i4zQNCpfTL6PEKqXOaT5khUNOr1NMaSUAV4WUplqEarqfYbEEik/olgTIPrnm/BuKXbAljAuyyVIjlp3U/5rs4rDODr28ydqz/w==',key_name='tempest-keypair-1066508683',keypairs=<?>,launch_index=0,launched_at=2023-11-08T19:16:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6be1b1fefdc746ce82ef167aaa70242c',ramdisk_id='',reservation_id='r-ito00dpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d031e1-e4c3-46c0-bfb5-c8044e0fbc93',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1794163812',owner_user_name='tempest-SnapshotDataIntegrityTests-1794163812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T19:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb9e57c2bda1499ca6bc2c1715c90ff1',uuid=972c8c4c-b50f-458a-842a-5293e62d3f08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Converting VIF {"id": "7889b8e9-bede-4bca-a697-393307b53405", "address": "fa:16:3e:f5:9d:89", "network": {"id": "198155be-447e-43c2-b570-4b46a1f250f6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-352938017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6be1b1fefdc746ce82ef167aaa70242c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7889b8e9-be", "ovs_interfaceid": "7889b8e9-bede-4bca-a697-393307b53405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.network.os_vif_util [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be') {{(pid=74820) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG os_vif [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be') {{(pid=74820) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7889b8e9-be, bridge=br-int, if_exists=True) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cb33183-950d-45a6-b1f8-b7d1ef7900c6) {{(pid=74820) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:25:51 user nova-compute[74820]: INFO os_vif [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:9d:89,bridge_name='br-int',has_traffic_filtering=True,id=7889b8e9-bede-4bca-a697-393307b53405,network=Network(198155be-447e-43c2-b570-4b46a1f250f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7889b8e9-be')
Nov 08 19:25:51 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Deleting instance files /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08_del
Nov 08 19:25:51 user nova-compute[74820]: INFO nova.virt.libvirt.driver [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Deletion of /opt/stack/data/nova/instances/972c8c4c-b50f-458a-842a-5293e62d3f08_del complete
Nov 08 19:25:51 user nova-compute[74820]: INFO nova.compute.manager [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 19:25:51 user nova-compute[74820]: DEBUG oslo.service.loopingcall [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74820) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.compute.manager [-] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Deallocating network for instance {{(pid=74820) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 19:25:51 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] deallocate_for_instance() {{(pid=74820) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 19:25:52 user nova-compute[74820]: DEBUG nova.network.neutron [-] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Updating instance_info_cache with network_info: [] {{(pid=74820) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 19:25:52 user nova-compute[74820]: INFO nova.compute.manager [-] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Took 0.85 seconds to deallocate network for instance.
Nov 08 19:25:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:52 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:25:52 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:25:52 user nova-compute[74820]: DEBUG nova.compute.manager [req-54df1dd7-16f0-45be-8a94-9bcdd895a576 req-5d78d5c1-2fe3-471a-9120-2e843b255668 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-vif-deleted-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:25:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:52 user nova-compute[74820]: INFO nova.scheduler.client.report [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Deleted allocations for instance 972c8c4c-b50f-458a-842a-5293e62d3f08
Nov 08 19:25:52 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-7f97f4d6-29b9-41e0-98c6-278eea1e5781 tempest-SnapshotDataIntegrityTests-1794163812 tempest-SnapshotDataIntegrityTests-1794163812-project-member] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-eb06d930-ffcf-4679-8079-eeebecbfb146 req-a173bcc1-f2e3-4ceb-9dea-a8b323b103d9 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received event network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 19:25:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-eb06d930-ffcf-4679-8079-eeebecbfb146 req-a173bcc1-f2e3-4ceb-9dea-a8b323b103d9 service nova] Acquiring lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:25:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-eb06d930-ffcf-4679-8079-eeebecbfb146 req-a173bcc1-f2e3-4ceb-9dea-a8b323b103d9 service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:25:53 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [req-eb06d930-ffcf-4679-8079-eeebecbfb146 req-a173bcc1-f2e3-4ceb-9dea-a8b323b103d9 service nova] Lock "972c8c4c-b50f-458a-842a-5293e62d3f08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:25:53 user nova-compute[74820]: DEBUG nova.compute.manager [req-eb06d930-ffcf-4679-8079-eeebecbfb146 req-a173bcc1-f2e3-4ceb-9dea-a8b323b103d9 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] No waiting events found dispatching network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 {{(pid=74820) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 19:25:53 user nova-compute[74820]: WARNING nova.compute.manager [req-eb06d930-ffcf-4679-8079-eeebecbfb146 req-a173bcc1-f2e3-4ceb-9dea-a8b323b103d9 service nova] [instance: 972c8c4c-b50f-458a-842a-5293e62d3f08] Received unexpected event network-vif-plugged-7889b8e9-bede-4bca-a697-393307b53405 for instance with vm_state deleted and task_state None.
Nov 08 19:25:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:26:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:26:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:26:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:26:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:26:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:16 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:21 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:26 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:30 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:31 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:33 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:34 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:35 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:35 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74820) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 19:26:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:26:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:26:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:36 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:37 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Starting heal instance info cache {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 19:26:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Rebuilding the list of instances to heal {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 19:26:37 user nova-compute[74820]: DEBUG nova.compute.manager [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Didn't find any instances for network info cache update. {{(pid=74820) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 19:26:38 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:39 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:41 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:42 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:45 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG oslo_service.periodic_task [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74820) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Auditing locally available compute resources for user (node: user) {{(pid=74820) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 19:26:46 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:26:47 user nova-compute[74820]: WARNING nova.virt.libvirt.driver [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 19:26:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Hypervisor/Node resource view: name=user free_ram=9182MB free_disk=25.017108917236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74820) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74820) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG nova.compute.provider_tree [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed in ProviderTree for provider: b6dd5339-b9ae-45ca-86de-93315b7f0863 {{(pid=74820) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG nova.scheduler.client.report [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Inventory has not changed for provider b6dd5339-b9ae-45ca-86de-93315b7f0863 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74820) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG nova.compute.resource_tracker [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Compute_service record updated for user:user {{(pid=74820) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 19:26:47 user nova-compute[74820]: DEBUG oslo_concurrency.lockutils [None req-76a58592-1665-4389-91c3-f97f2c53673a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74820) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 19:26:48 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:51 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74820) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 19:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74820) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 19:26:56 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:27:01 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 19:27:06 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 19:27:11 user nova-compute[74820]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74820) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}